-- Logs begin at Wed 2022-08-17 07:53:54 UTC, end at Wed 2022-08-17 08:57:28 UTC. -- Aug 17 08:24:02.993678 dv-cinder-853315-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 08:24:03.002209 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 08:24:03 2022] *** Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: nodename: dv-cinder-853315-5-iscsi Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: machine: x86_64 Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: clock source: unix Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: pcre jit disabled Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: detected number of CPU cores: 4 Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: current working directory: / Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: detected binary path: /usr/bin/uwsgi-core Aug 17 08:24:03.004215 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: your processes number limit is 47680 Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: your memory page size is 4096 bytes Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: detected max file descriptor number: 2048 Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: lock engine: pthread robust mutexes Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: thunder lock: enabled Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 08:24:03.004816 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 08:24:03.043696 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: Python main interpreter initialized at 0x55aa37d8e9c0 Aug 17 08:24:03.043696 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: python threads support enabled Aug 17 08:24:03.043696 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: your server socket listen backlog is limited to 100 connections Aug 17 08:24:03.043696 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: your mercy for graceful operations on workers is 90 seconds Aug 17 08:24:03.044046 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 08:24:03.044127 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: *** Operational MODE: preforking *** Aug 17 08:24:03.044361 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: *** uWSGI is running in multiple interpreter mode *** Aug 17 08:24:03.044361 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: spawned uWSGI master process (pid: 81583) Aug 17 08:24:03.044550 dv-cinder-853315-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 17 08:24:03.047573 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: spawned uWSGI worker 1 (pid: 81594, cores: 1) Aug 17 08:24:03.047573 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: spawned uWSGI worker 2 (pid: 81595, cores: 1) Aug 17 08:24:03.047573 dv-cinder-853315-5-iscsi devstack@keystone.service[81583]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 08:24:07.306181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:24:07.306181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: from cryptography.utils import int_from_bytes Aug 17 08:24:07.306961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:24:07.306961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: from cryptography.utils import int_from_bytes Aug 17 08:24:07.307401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:24:07.307401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: from cryptography.utils import int_from_bytes Aug 17 08:24:07.307528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:24:07.307528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: from cryptography.utils import int_from_bytes Aug 17 08:24:07.356811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:24:07.357008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:24:07.357108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:24:07.357197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] command line args: [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:24:07.357274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:24:07.357401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] command line args: [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:24:07.357478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:24:07.357610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ================================================================================ {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:24:07.357690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:24:07.357835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ================================================================================ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:24:07.357920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] admin_token = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] admin_token = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] config_dir = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] config_dir = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] config_source = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] debug = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] config_source = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.358813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] debug = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.359973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_config_append = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_config_append = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_dir = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.360919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_dir = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_file = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.361994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.362897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.363907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] publish_errors = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] publish_errors = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.364945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.365826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.366415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.366590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] standard_threads = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.366669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] standard_threads = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.366820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.366909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] use_journal = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] use_journal = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] use_json = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] use_json = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] use_stderr = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] use_stderr = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.367950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] use_syslog = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.368029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] use_syslog = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.368149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.368233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:24:07.368403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.368481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.368639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.368727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.368895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.368971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.369939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.370920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.371909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.372795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.373851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.374941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.375924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.376950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.377887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.378938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.379967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.380892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.381051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.381130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.381285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.381400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.381522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.382859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.383972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.384945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.385877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.386985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.387967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.388980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.389937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.390875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.391951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.392956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.external = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.393894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.external = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.password = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.394873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] auth.token = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.password = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] auth.token = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.395984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.396924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.397979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.398935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.399940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.400923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.401865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.402972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.403966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.404941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.405961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.406885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.407864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.408992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.409994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.410954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.411970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.412934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.413957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.414894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.415864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.416962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.417923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.418930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.419893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.420857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421006 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.421944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.422946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.423924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.424999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.425961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.426978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] role.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] role.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.427860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.428017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] role.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.428095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] role.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.428166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.428329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.429917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.430895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.431879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.432986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.433966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.434918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.435883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436049 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.436971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.437989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.438960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.439921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.440863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.connection = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.441885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.442956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.443997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.444706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.444799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.444925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.445940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.446090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.446180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.446264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:24:07.446340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:24:07.446475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:24:07.475426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.475644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.475751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.475832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.475908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.475984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.484652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.484767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.513440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.513644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.513738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.513873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.566801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.567169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.617104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.617340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.617516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.617752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.775929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.776065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.776150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.776283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.776370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.776527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.799878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.800925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.801054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.801138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.801265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.801350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.801477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.812977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.813185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.826973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.827632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 08:24:07.844286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.844502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 08:24:07.844585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.844713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 08:24:07.844848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.845050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 08:24:07.845133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.845250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 08:24:07.845332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.845527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.845619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.845790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.846071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.846294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.846376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.846556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.856967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.857095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.857250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.864065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.864174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.867500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.867654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.867809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.867940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.868938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.869978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.870150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.870254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.870423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.870524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.893114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.893502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.894583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.894870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.894954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.895225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.899584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.899880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.899964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.900169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.900266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.900449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.906490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.906714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.906798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.906999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.910856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.911066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.911153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.911357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.911440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.911665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.911753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.911950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.912765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.913345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.913557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.930821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.930959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.931100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.931240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.934987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.935088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.938222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.938309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.938524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.938607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.942734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.942823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.945884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.945974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.949121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.949221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.949422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.949507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.949950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.950894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.967110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.967301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.967939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.974636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.974798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.976785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.976907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.977064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.977190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.979696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.979871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.979999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.980832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.981035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.992441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.992588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:07.992727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.992871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.993996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.994131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.994270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:07.994354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.009881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.012765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.012964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.015832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.015924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.017277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.018718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.018803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.019007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.019304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.020199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.021682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.021968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.022799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.026268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.027772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.029281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.030625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.030738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.030919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.031204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.031490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.033633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.033935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.034222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.034510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.039938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.040233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.040512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.043028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.043324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.043655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.047304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.047610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.047891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.048167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.048438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.048709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.048981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.049262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.049540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.049807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.050087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.050346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.050536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 08:24:08.050618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.050824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.050908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.051111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.051393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.051707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.051988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.052266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.052550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.052837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.053110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.053393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.053682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.053960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.054245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 08:24:08.084671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa37d8e9c0 pid: 81594 (default app) Aug 17 08:24:08.088663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa37d8e9c0 pid: 81595 (default app) Aug 17 08:24:08.088823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d8f0c-e31d-4571-bdf9-65ece592de45 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:08.089106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d8f0c-e31d-4571-bdf9-65ece592de45 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:08.089377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d8f0c-e31d-4571-bdf9-65ece592de45 None None] PATH_INFO: `/v3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:08.093524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Wed Aug 17 08:24:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:14.541149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773733-956c-4d30-9eda-37b00097755e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:14.541655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773733-956c-4d30-9eda-37b00097755e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:14.541737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773733-956c-4d30-9eda-37b00097755e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:14.545996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:14.551231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:14.551647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:14.551807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:14.622481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: INFO dbcounter [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] Registered counter for database keystone Aug 17 08:24:14.641342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG oslo_db.sqlalchemy.engines [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:24:14.647694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writer thread running {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:24:14.823414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG passlib.handlers.bcrypt [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81594) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 08:24:14.823794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG passlib.handlers.bcrypt [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81594) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 08:24:14.878432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:14.880063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:15.007432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 08:24:15.441011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773733-956c-4d30-9eda-37b00097755e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:15.509953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: INFO dbcounter [None req-2f773733-956c-4d30-9eda-37b00097755e None None] Registered counter for database keystone Aug 17 08:24:15.530965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG oslo_db.sqlalchemy.engines [None req-2f773733-956c-4d30-9eda-37b00097755e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:24:15.537136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writer thread running {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:24:15.655459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773733-956c-4d30-9eda-37b00097755e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:15.659801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:15.660424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:15.660701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:15.660960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:15.669306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:15.720697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 08:24:15.720981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15acaaa-02e0-4a16-a70a-f56a0e3c799e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:15.730260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Aug 17 08:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 08:24:15.736248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:15.750915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe570f1-3756-4027-a79f-2e51688abeba None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:15.755356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:15.756464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:15.756743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:15.757610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] PATH_INFO: `/v3/projects/0453a8b2bb634303b77e24e668baded5` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:15.759154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] RBAC: Authorizing `identity:get_project(project_id=0453a8b2bb634303b77e24e668baded5)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:15.810408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 08:24:15.810747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50104275-ef40-4e9c-b99d-45837a9e5cae admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:15.815186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Wed Aug 17 08:24:15 2022] GET /identity/v3/projects/0453a8b2bb634303b77e24e668baded5 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:17.675872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc263-9403-468d-b902-d83151deb1b8 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:17.676313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc263-9403-468d-b902-d83151deb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:17.676396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc263-9403-468d-b902-d83151deb1b8 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:17.681195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:17.686455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:17.686891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:17.686982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:17.706675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:17.708272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:17.716466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 08:24:17.977226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cc263-9403-468d-b902-d83151deb1b8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:17.989081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cc263-9403-468d-b902-d83151deb1b8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:17.993264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:17.993849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:17.994125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:17.994393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:18.001768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:18.003559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52574a3-750a-4875-ac08-d8592b29d00a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:18.012040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Aug 17 08:24:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:24:18.017086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:18.026737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a15d2-c47f-441a-8fd5-6b7918fd6f1f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:18.030995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:18.031647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:18.031929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:18.032198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:18.033494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:18.035285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d215c7-96cb-4305-91b6-1d8c0f0f713b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:18.036819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Wed Aug 17 08:24:18 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:19.990503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be41c-d69d-4d11-baef-6515be9a4270 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:19.991059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be41c-d69d-4d11-baef-6515be9a4270 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:19.991059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be41c-d69d-4d11-baef-6515be9a4270 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:19.992892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:19.998027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:19.998446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:19.998579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.001903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591f7d-58a2-4dcf-b80c-24dcc2b744af None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.002187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591f7d-58a2-4dcf-b80c-24dcc2b744af None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.002520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d591f7d-58a2-4dcf-b80c-24dcc2b744af None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.003798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:20.009422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.009705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.009975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.017426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:20.018617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:20.050798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG passlib.handlers.bcrypt [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 08:24:20.051219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG passlib.handlers.bcrypt [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 08:24:20.098617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:20.102843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:20.104490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:20.201764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:20.367887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.391792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:20.471028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d76a9-71fe-405b-8d11-2075b31ce972 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.471436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.505179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.505806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.506082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.506350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.517590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:20.526270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:20.527191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:20.528086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:20.533029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.574393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bae29-85db-4885-8553-c3d04bd9cade None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.576927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:20.614807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:20.616151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.617653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.617981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.618212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.634065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c46-2b83-42bf-aade-d06e17c7a574 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.667492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.668126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.668406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.668684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.669350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:20.669654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:20.671056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:20.683197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:20.684866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:20.686385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:20.688674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.783110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 08:24:20.788039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666baf22-f37d-475f-b825-ac893be288d1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.788357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.791555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:20.824234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.824859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.825142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.825420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.826836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:20.828319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:20.829868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:20.835835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.849838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:20.892134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eba5d-e2cc-420d-a632-ccc16a3d9762 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.926424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.927283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.927569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.927841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.936650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025023-4702-4a01-a118-3f0f15c490b2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:20.946030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:20.947498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:24:20.965861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:20.966801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:24:20.967691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:24:20.967691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:24:20.967691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:20.967691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:24:20.970608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:20.971237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:20.971629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:20.971900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:20.972587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:20.973011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:20.974432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:20.981247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:20.982108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:21.028047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:21.061850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:21.072235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77fd9a-b4e2-4e55-aad5-36f353b6cdeb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:21.082327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b8db-566b-4886-9b85-f65145aa67a0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:21.106205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:21.106811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:21.107085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:21.107364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:21.108135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:21.108444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:21.109830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d003cf-ce6f-49d2-8251-4e76d928246b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:21.115294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:21.115921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:21.116197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:21.116462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:21.117783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.domain.id=default, user.id=0f93f4121d434aed821124eb6820eb0b) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:21.118085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:21.119489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4f7c1-e0f8-44b4-b50f-b90e5a7f8c99 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:21.126340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/role_assignments?user.id=0f93f4121d434aed821124eb6820eb0b&scope.domain.id=default&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:21.128532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:23.383973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dac4b-3b31-4008-b515-c22dbe8e9194 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.384483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dac4b-3b31-4008-b515-c22dbe8e9194 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.384483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dac4b-3b31-4008-b515-c22dbe8e9194 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.385829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:23.391432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f570b7-31b0-4440-b6a8-0449e731ca19 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.391861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f570b7-31b0-4440-b6a8-0449e731ca19 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.392025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f570b7-31b0-4440-b6a8-0449e731ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.416500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f1f570b7-31b0-4440-b6a8-0449e731ca19 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:23.417708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f1f570b7-31b0-4440-b6a8-0449e731ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:23.503986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:23.544143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a03c-d5f1-44e3-8a8b-b0a4780ebb04 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.544711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a03c-d5f1-44e3-8a8b-b0a4780ebb04 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.544985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a03c-d5f1-44e3-8a8b-b0a4780ebb04 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.546585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:23.551706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5281e-7f79-4895-8b3c-6a82de007adf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.551993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5281e-7f79-4895-8b3c-6a82de007adf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.552332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5281e-7f79-4895-8b3c-6a82de007adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.575631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9cb5281e-7f79-4895-8b3c-6a82de007adf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:23.577078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9cb5281e-7f79-4895-8b3c-6a82de007adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:23.655418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:23.660683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87726c3-514a-409a-b5d2-295733e2fbd8 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.661202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87726c3-514a-409a-b5d2-295733e2fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.661667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87726c3-514a-409a-b5d2-295733e2fbd8 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.665194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 14/25] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:23.669005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.669439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.669871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.696544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:23.700536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:23.702171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:23.758658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc627852-4379-4a77-919d-a7ee4220e575 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.759192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc627852-4379-4a77-919d-a7ee4220e575 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.759628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc627852-4379-4a77-919d-a7ee4220e575 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.761429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:23.772526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:23.773033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:23.773445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:23.801164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:23.802582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:23.809808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:23.909520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:23.956242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.053543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:24.084466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2398d0-2244-4207-8b2d-af9199083f18 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.127492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.128147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.128427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.128697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.138874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.140372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:24:24.164732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:24.165565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:24:24.166379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:24:24.166379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:24:24.166379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:24.166379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 16/30] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:24.172854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.204522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.325278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae789-8394-4b4d-afb6-b9056384bdd0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.325667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d898f5-fbf8-45c3-88bb-68fd3d3f67af None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.333852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:24.359126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:24.367290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.368129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.368552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.368966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.370024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:24.370517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.371098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.371848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.372194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.372531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.372888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.373374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.375008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.387456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:24.389187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.499150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262ce03-88f4-47c8-88d7-a24e502c8b62 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.514154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 17/32] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 17 08:24:24 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:24:24.520784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.540578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.541222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.541500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.541770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.546371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.549958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.677423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70e86-51e5-4fc2-ac45-7e01e8e8eb05 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.730125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.731115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.731658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.732160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.732910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 17 08:24:24 2022] POST /identity/v3/roles => generated 219 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:24.733946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.745240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:24.751269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:24.752232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:24.753004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:24.755670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:24.763409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:24.766727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:24.841179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:24.880425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915f7b-226a-4736-9e3b-893794c46939 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.939369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a59d34-99cd-4a93-9583-994e5a905ea2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:24.950772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.951669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.951949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.952221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.953127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.954709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f218e2-64a6-48a7-9607-2c8ff33718b4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.994527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:24.995151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.995432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:24.995740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:24.996482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:24.996789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:24.998209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:24:24 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:24.998348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:24.999589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4df64a-4829-4537-aa4c-436dba7fe889 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:24.999877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4df64a-4829-4537-aa4c-436dba7fe889 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.000157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4df64a-4829-4537-aa4c-436dba7fe889 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.001575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:25.008646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33d1fd-ac8a-4ffd-892e-1b697c499155 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.008943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33d1fd-ac8a-4ffd-892e-1b697c499155 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.009198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33d1fd-ac8a-4ffd-892e-1b697c499155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.015269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 19/37] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:25.020666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.033483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bf33d1fd-ac8a-4ffd-892e-1b697c499155 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:25.035062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf33d1fd-ac8a-4ffd-892e-1b697c499155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:25.112661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:25.135214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c26be-c910-4c76-8117-aab889c5f33c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.135516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c26be-c910-4c76-8117-aab889c5f33c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.135813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c26be-c910-4c76-8117-aab889c5f33c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.137187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 20/39] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:25.142628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.142903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.143182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.163395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:25.165042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:25.167692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:25.176341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159de02-cb71-4f34-9109-ccc81e29c731 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.251389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:25.295062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:25.322368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.322999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.323276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.323634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.324786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.326462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.328256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 20/41] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:25 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:25.333488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.385588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.438699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e6e6-b7b5-4a51-a827-603fa6be8bf8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.475341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.476292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.476775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.477099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.478209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.479665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.481379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 22/42] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:25.486750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.492430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245968b-87e5-4417-ba44-1ea5417eee8e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.495533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:25.529245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.529891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.530524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.530524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.531683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.533107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.534656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:25.535450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.581050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:25.591903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee63f-15d6-48d4-aff1-8e5dfe6a7425 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.628645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.629298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.629577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.629853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] PATH_INFO: `/v3/domains/default/users/0f93f4121d434aed821124eb6820eb0b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.632038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0f93f4121d434aed821124eb6820eb0b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.633538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.641351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6242cd-4239-4912-a277-f0f4e047c659 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.648200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1361 bytes} [Wed Aug 17 08:24:25 2022] PUT /identity/v3/domains/default/users/0f93f4121d434aed821124eb6820eb0b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:25.649160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:25.678642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.679898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.680201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.680478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.681163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.682771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2b84-ea16-46f6-8f90-39dd94a8b95d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.700259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 17 08:24:25 2022] POST /identity/v3/roles => generated 223 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:25.735804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:25.779475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf6fa2-ddf2-4c1d-b8e6-5631c5cb1d30 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:25.822400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:25.823055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:25.823322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:25.823628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:25.824286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:25.825749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b8af-ee25-458c-a373-12c37a1f6c10 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:25.855365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:24:25 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:27.562473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403c9d0-5a4e-44fa-9d6c-c04eebe84d86 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:27.562985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403c9d0-5a4e-44fa-9d6c-c04eebe84d86 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:27.563070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403c9d0-5a4e-44fa-9d6c-c04eebe84d86 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:27.564387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:27.569675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b015-ef7a-4ef3-971a-c313e469838e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:27.570105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b015-ef7a-4ef3-971a-c313e469838e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:27.570292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0b015-ef7a-4ef3-971a-c313e469838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:27.588729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0af0b015-ef7a-4ef3-971a-c313e469838e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:27.589899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0af0b015-ef7a-4ef3-971a-c313e469838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:27.659168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:27.751272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31729-7b2d-4cb4-8f57-9ba24b714d11 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:27.751580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31729-7b2d-4cb4-8f57-9ba24b714d11 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:27.751869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31729-7b2d-4cb4-8f57-9ba24b714d11 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:27.753347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 24/49] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:27.758225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:27.758507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:27.758781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:27.776813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:27.777980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:27.820821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:27.845671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:27.927156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31729-7b2d-4cb4-8f57-9ba24b714d11 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.028062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31729-7b2d-4cb4-8f57-9ba24b714d11 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.030355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:28.063098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.063748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.064026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.064316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.074677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:28.079757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:28.080844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:28.081665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:28.087164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.113885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.187457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddb44-020d-40bc-8562-ddd16b4523f7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.213704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529949c-baf9-4e6b-a0f2-4f186e40c8e8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.222921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.223521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.223826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.224095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.224749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:28.225046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.226432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.237562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:28.243571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.249382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.250020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.250298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.250569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.251763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.253243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.255064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:28.261367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.293971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:28.366797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c1c2-d33a-459e-86fe-88cca5fcb154 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.388677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:28.401284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.401894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.402176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.402452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.403096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.404563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.432558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 27/54] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Aug 17 08:24:28 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:24:28.448278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080324b9-e55d-4c4e-9f18-7a709aeb03c6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.484521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.485232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.485478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.485734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.486923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.488421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.490053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:28 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:28.496370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.585645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:28.605673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143009b-5b11-4428-8598-546d00dfe824 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.640148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.640791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.641077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.641353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.642467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.643959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c955c-0ce9-4484-a841-4915bda61186 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.645532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:28.651400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:28.750160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6cf0-b825-4872-8184-84ea167cf0dd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:28.758831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:28.782888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:28.783505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:28.783819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:28.784122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:28.784846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.domain.id=default, user.id=0f93f4121d434aed821124eb6820eb0b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:28.785158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:28.786600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e61ed4-3dc4-49fe-ba64-3ef0a4d9d513 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:28.795330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Aug 17 08:24:28 2022] GET /identity/v3/role_assignments?user.id=0f93f4121d434aed821124eb6820eb0b&scope.domain.id=default&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:30.313500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeec46-933b-4c84-a1f2-ba2f74ba178e None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:30.314013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeec46-933b-4c84-a1f2-ba2f74ba178e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:30.314096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeec46-933b-4c84-a1f2-ba2f74ba178e None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:30.315370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:30.320499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:30.320883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:30.321038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:30.338698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:30.339911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:30.403278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:30.671909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeec46-933b-4c84-a1f2-ba2f74ba178e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:30.769669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeec46-933b-4c84-a1f2-ba2f74ba178e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:30.802628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:30.803245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:30.803523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:30.803819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:30.804969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:30.806423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e675bca-6eef-44b1-a9ee-ea4abfbc43b7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:30.807988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:30.813405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:30.907480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7cf92-f220-4536-ae59-d0596cf09385 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:30.908953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:30.940134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:30.940726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:30.941004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:30.941274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:30.941909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:30.943346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe8c3a-c3a4-425a-91f2-1a3d890a3b5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:30.969954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:30 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:24:33.933839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746488-1745-4f61-96c7-94d55d4588fe None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:33.934367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746488-1745-4f61-96c7-94d55d4588fe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:33.934367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746488-1745-4f61-96c7-94d55d4588fe None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:33.935743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:33.941042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd639-561a-4db5-a4f1-8ae33782ba6d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:33.941852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd639-561a-4db5-a4f1-8ae33782ba6d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:33.942322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cd639-561a-4db5-a4f1-8ae33782ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:33.954938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689639d-ca56-4c9b-97aa-b8cab6ee2eee None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:33.955496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689639d-ca56-4c9b-97aa-b8cab6ee2eee None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:33.956005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689639d-ca56-4c9b-97aa-b8cab6ee2eee None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:33.957514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:33.963177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4dc18-99ec-4aeb-ae06-a5913fdf37f2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:33.963744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4dc18-99ec-4aeb-ae06-a5913fdf37f2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:33.964216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4dc18-99ec-4aeb-ae06-a5913fdf37f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:33.991635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-026cd639-561a-4db5-a4f1-8ae33782ba6d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:33.993189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-026cd639-561a-4db5-a4f1-8ae33782ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:33.994277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ffb4dc18-99ec-4aeb-ae06-a5913fdf37f2 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:33.998003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ffb4dc18-99ec-4aeb-ae06-a5913fdf37f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:34.027896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:34.112060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:34.120444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:34.336035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58767af6-aa80-4b65-9ecc-0a4170d879b5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.336524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58767af6-aa80-4b65-9ecc-0a4170d879b5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.336963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58767af6-aa80-4b65-9ecc-0a4170d879b5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.338723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 33/66] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:34.343758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769da11-6260-4a72-84b0-747cda93072f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.344210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769da11-6260-4a72-84b0-747cda93072f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.344628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769da11-6260-4a72-84b0-747cda93072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.367956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d769da11-6260-4a72-84b0-747cda93072f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:34.369353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d769da11-6260-4a72-84b0-747cda93072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:34.412497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d0-3b21-42f2-b6d9-cab887d1eb35 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.413137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d0-3b21-42f2-b6d9-cab887d1eb35 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.413618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9116d0-3b21-42f2-b6d9-cab887d1eb35 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.415211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 34/67] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:34.420709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.421274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.421744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.451063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:34.452965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:34.486997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:34.514473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769da11-6260-4a72-84b0-747cda93072f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:34.555576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:34.555576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:34.571484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:34.628882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:34.650041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769da11-6260-4a72-84b0-747cda93072f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:34.661384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15357e-3d68-4835-93b2-75da0e21847e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:34.687184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:34.687853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.688135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.688410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.697647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:34.698283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.698560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.698829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.699204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-6b49648e-53b9-4224-b984-4e4b7d34c338 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:34.704488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:34.705334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:34.706106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:34.710364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:34.710689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 35/70] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:24:34.712475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914757e-5a6d-4250-b3d5-6b5679625ba0 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.712755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914757e-5a6d-4250-b3d5-6b5679625ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.713027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914757e-5a6d-4250-b3d5-6b5679625ba0 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.714519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 36/71] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:34.715410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914757e-5a6d-4250-b3d5-6b5679625ba0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-574e725f-2f6a-4351-8774-790abc396cb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:34.717004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:34.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:34.721532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 36/72] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:34.726961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.726961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.726961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.744012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:34.745212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:34.814168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 37/73] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:34.815001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:34.825769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:34.837167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914757e-5a6d-4250-b3d5-6b5679625ba0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:34.886309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:34.886913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.887189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.887458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.888149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:34.888453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:34.889831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:34.897884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 37/74] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:34.898676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:34.901214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:34.946367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96922e-b706-47cf-936c-9adca6fb4854 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:34.989876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:34.990783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:34.990783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:34.991023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:34.991717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:34.992049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:34.993419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.006171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.006171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.008842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028fe9d-ad14-4097-a3d4-7c2a95d81150 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.047867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.048510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.048980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.049170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.060362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:35.066068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:35.066918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:35.068082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:35.072514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.079737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.111505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398f989-ab75-4771-a655-5d43ebab4d29 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.134133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.143840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.144407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.144689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.144964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.155438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:35.161639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:35.162469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:35.168292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.173958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b9a26-a0ab-426c-80b7-8455352bff7a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.206794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.207422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.207733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.208014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.209150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.210588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.212701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 39/78] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.217341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.265301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a963ff-2a26-459f-a736-e5706a34c10b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.292861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.298768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.299390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.299702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.299977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.311891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81f1e-6d60-445d-99b9-157c4dcb769e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.315036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.316508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.318116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.320083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.341157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.347240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.347878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.348158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.348428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.349083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:35.349455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.350812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.358527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.359291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.420679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc4da0-2bf0-4746-b2ad-059d8f003a95 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.453778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.454397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.454677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.454953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.455769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb806d-b547-42fb-ab7d-6bafcefd63b2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.456106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.457532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.459080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 41/81] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.464171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.488857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.489456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.489736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.490007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.490664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:35.490999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.492393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.500121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.500121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.521427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.554640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.564613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab17-0822-44c9-acc7-94d6a3d39090 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.599498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.600145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eadcd5-e940-46af-803c-6aae287d5531 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.600241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.600440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.600722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.635498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.636128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.636410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.636686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.666507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.667997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.703743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.705124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.720650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.756458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.764798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 42/83] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:35.765608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.806726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 42/84] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:35.807534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.862239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc649ce-fcaf-4aee-bbdb-c2e5f3073bd2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.896484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.897106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.897385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.897668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.898830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.900296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.901864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:35.902699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.904842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d53b90-1c18-476a-b7da-a64f36815e64 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:35.926197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:35.939664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:35.940266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:35.940545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:35.940816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:35.941469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:35.942893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:35.969464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 43/86] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:35 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:35.970179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:35.982824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.012855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed555-4620-47f0-ae77-3967bf07f153 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.050345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.050991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.051277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.051572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.052764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.054226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.056409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 44/87] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.057209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.092731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe37bd-7ee5-4609-962f-97ee804b252f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.136009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.136656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.136942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.137219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.139169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.140660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.142497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:35 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.143078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.172743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.187407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29f38-71f9-4559-ace6-2a44eeac50be None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.232437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.233470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.233948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.234415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.237478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.239156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.241208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.243198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 45/89] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.244653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.265867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3693be-1e8a-4db8-a3c3-59f9c8bafad7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.306441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.307061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.307340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.308400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.363632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf52fc-c021-47a8-a2bb-0ff41d2d2d72 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.392270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.393762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.411457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.412638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.413521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.414537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.457055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.483707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.513988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.516025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 45/90] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:36.516478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.517671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.638081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ce9ae-3866-4207-ad6d-1a0333c2a7d3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.653292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 46/91] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:36.654442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.685529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.686495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.686966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.687429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.688375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=0f93f4121d434aed821124eb6820eb0b) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:36.688908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.690605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.696668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/role_assignments?user.id=0f93f4121d434aed821124eb6820eb0b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.697720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.764043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.798102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:36.855697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ac6b-01bf-4ed0-a7be-10bfc9567340 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.870422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7edc66-1b13-4f1f-afc2-15ae11af72dd None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:36.903467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.904454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.904927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.905414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.906335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:36.906854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.909364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.910577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:36.911220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:36.911504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:36.911913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:36.913415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:36.914645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:36.916368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.916617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:36.917584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:36.924119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:37.105054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb9e83-3450-435b-9ab0-06810652e62e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:37.112523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1cf8f-4cfa-41e2-8aa0-b72c3bda0e05 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:37.123967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:37.161316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:37.161858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:37.163126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:37.163666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:37.164490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:37.165510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:37.166001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:37.167815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:37.175052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 48/95] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=599414de16304217a39bf1ab5b7d8724 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:37.197292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:37.197968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:37.198250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:37.198526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] PATH_INFO: `/v3/projects/72061eebe2234509bcbfd97e42a2efe3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:37.199751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] RBAC: Authorizing `identity:get_project(project_id=72061eebe2234509bcbfd97e42a2efe3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:37.201226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838af37d-16e4-444a-9b87-682b95e1b665 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:37.203495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:36 2022] GET /identity/v3/projects/72061eebe2234509bcbfd97e42a2efe3 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:37.209377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:37.323656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9f52-630f-43f1-a8fb-fa9ba02fbb7b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:37.364554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:37.365101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:37.365385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:37.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:37.366411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=72061eebe2234509bcbfd97e42a2efe3, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:37.366727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:37.368782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0758-f328-4f7f-8782-1c7bf634b39a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:37.378726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:37 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=72061eebe2234509bcbfd97e42a2efe3&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:38.405475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca1a-20da-4a65-88c2-bb62e115fce6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:38.406542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca1a-20da-4a65-88c2-bb62e115fce6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:38.407029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca1a-20da-4a65-88c2-bb62e115fce6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:38.408607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:38.413940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422fd1-66e5-46b8-a2ae-155120bd0fc5 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:38.414752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422fd1-66e5-46b8-a2ae-155120bd0fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:38.415248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422fd1-66e5-46b8-a2ae-155120bd0fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:38.440514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4e422fd1-66e5-46b8-a2ae-155120bd0fc5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:38.442081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4e422fd1-66e5-46b8-a2ae-155120bd0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:38.479691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:38.523200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:38.613467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff3e6-4bfc-442e-89d3-1c3554deea14 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:38.613981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff3e6-4bfc-442e-89d3-1c3554deea14 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:38.614449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff3e6-4bfc-442e-89d3-1c3554deea14 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:38.616029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:38.621376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:38.621899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:38.622380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:38.649098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:38.650597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:38.729545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:38.997068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff3e6-4bfc-442e-89d3-1c3554deea14 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.111324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff3e6-4bfc-442e-89d3-1c3554deea14 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.128619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.145563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:39.146195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.146471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.146742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.157189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:39.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:39.163331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:39.164798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:39.173096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.231204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:39.332984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09e33-37f8-44ce-a827-6a5fd3bd5b23 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.362057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:39.365192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5111a7-28f3-4a9c-8f6d-aeebd7b51040 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.416870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:39.418145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.418620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.419088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.419993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:39.420778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:39.422338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:39.444441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:39.451085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.457695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:39.458874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.464502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.464961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.466286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:39.468036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:39.469797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:39.476424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.672056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dab165-2e18-4beb-9859-448f9eb1af7b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.689642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100893-cb6e-4c2b-afe7-dc456c354db7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.719643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:39.720986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.721554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.722269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.723136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:39.725237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621bf4a-cc18-4a2b-9dfc-38566e0bf0e4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:39.725700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:39.751379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:39.752403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.752898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.753361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] PATH_INFO: `/v3/users/b673e684457b45b69eb6a9583d38ed46` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.765795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 53/105] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:24:39 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:24:39.767318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2b04-3fbe-4ea5-b626-6db94c4e998b None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.767836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2b04-3fbe-4ea5-b626-6db94c4e998b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.771918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2b04-3fbe-4ea5-b626-6db94c4e998b None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.774559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 54/106] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:39.781171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff52d-4c74-4eba-8015-2d87c53ccc1e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.783328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff52d-4c74-4eba-8015-2d87c53ccc1e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.783856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff52d-4c74-4eba-8015-2d87c53ccc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.803118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] RBAC: Authorizing `identity:get_user(user_id=b673e684457b45b69eb6a9583d38ed46)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:39.806094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:39.808149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 53/107] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:39 2022] GET /identity/v3/users/b673e684457b45b69eb6a9583d38ed46 => generated 289 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:39.814359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:39.832769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2d6ff52d-4c74-4eba-8015-2d87c53ccc1e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:39.835224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2d6ff52d-4c74-4eba-8015-2d87c53ccc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:39.865432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:39.956106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 55/108] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:39.965904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2df6-641c-4a31-bda6-06f923c118cc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:39.970611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1880-5785-402d-be71-af20b0a4315e None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.971185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1880-5785-402d-be71-af20b0a4315e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.971708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f1880-5785-402d-be71-af20b0a4315e None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.973552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 56/109] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:39.977638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455878-a746-4dfc-a83e-d01c26c50d94 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.977940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455878-a746-4dfc-a83e-d01c26c50d94 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.978221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455878-a746-4dfc-a83e-d01c26c50d94 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:39.979573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 57/110] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:39.980801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f61e2-a4ed-45f9-a6ef-b85ad96c8b58 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:39.981075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f61e2-a4ed-45f9-a6ef-b85ad96c8b58 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:39.981343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f61e2-a4ed-45f9-a6ef-b85ad96c8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.005061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.005678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.005957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.006316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.008912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-408f61e2-a4ed-45f9-a6ef-b85ad96c8b58 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:40.010266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-408f61e2-a4ed-45f9-a6ef-b85ad96c8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:40.057546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.089662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:40.091239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:40.110158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 58/111] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:40.116902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.117131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.117440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.152808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:40.154003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:40.234326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 59/112] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:40.254272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 54/113] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:40.255436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.262774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.271900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.362841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de504df1-5031-47d7-b66b-dbe0c594f248 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.371837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.413048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.413687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.413965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.414264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.415518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:40.416989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:40.418784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 55/114] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:40.428514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.443328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ecd41-d837-424b-aea4-8e057f41f424 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.511736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.512369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.512644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.512919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.528857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:40.534576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:40.535439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:40.536239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:40.538675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 60/115] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:40.539818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.574175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8508-328e-43e3-b922-870a89e5cf0b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.621052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.621668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.622002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.622228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.622954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=b673e684457b45b69eb6a9583d38ed46) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:40.623263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:40.624734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:40.627903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.630696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 56/116] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/role_assignments?user.id=b673e684457b45b69eb6a9583d38ed46&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:40.631337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.635808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.667251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527cf6d-7590-4677-bf0d-ea675e9afbcb None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.707375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.708069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.708345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.708644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.720847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:40.725837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:40.727298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 61/117] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:40.733385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.779659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0410696-e9b3-4878-b362-96ebb5669b21 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.821962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.822960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.823402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.823907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.824749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:40.825250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:40.827000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83751-7a55-4172-8a88-e7f35639665a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:40.842737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 57/118] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:40.844489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84390e0-8105-4592-b051-03a1a609acf5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.844939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84390e0-8105-4592-b051-03a1a609acf5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.845062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef38d8-a02c-4c6f-af12-d1a35103ba50 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:40.845491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84390e0-8105-4592-b051-03a1a609acf5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.847068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 58/119] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:40.848071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84390e0-8105-4592-b051-03a1a609acf5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.895894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:40.908042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:40.908687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:40.908965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:40.909243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:40.924573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:40.930664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:40.931532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:40.932437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 62/120] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:40.933089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:40.965515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.020004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84390e0-8105-4592-b051-03a1a609acf5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.064132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394fac0-0e74-4788-98f6-db539e156239 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.074586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.075989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.076984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.077737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.078727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:41.079794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.081785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.105241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.105891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.106218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.106494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.107659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.109368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4eca6-a3bd-46e0-9d25-ceb41de1a8f8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.115392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 63/121] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.115392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.115392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.115392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.115745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 59/122] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.115745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.133791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:41.139566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:41.194390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.216013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 64/123] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:41.216901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.328975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78f02-9c41-48f9-8f74-f3b36dfeeaad None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.366155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.366917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.367227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.369096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.369096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.370102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.372208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 65/124] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.373053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.373698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765946-2dc4-4728-8707-4ba56d48603d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.447319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.479933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.496500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04628c-75b6-41df-939a-c0288cdaa04f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.506801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.510110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.510408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.510689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.511380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:41.511714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.516102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.534329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.535083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.535460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.535898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.537100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.538636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.540656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 66/125] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.541339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 60/126] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.541577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.546836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.709020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651832-f366-472c-83e2-be6bd65db5c8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.732579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b7e6-06a1-4bfb-a24e-b30ebecad0a8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.734280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.748582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.749491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.749873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.750369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/00c756b5256046849a97e0014acf510b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.752586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, user_id=00c756b5256046849a97e0014acf510b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.754258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.772224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 67/127] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:41 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/00c756b5256046849a97e0014acf510b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:41.772932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.773065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.773767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.774050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.774324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.775614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.777266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.779051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 61/128] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.780013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:41.885606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:41.917437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebff37-1340-47a1-9acf-cda503d78eb2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.964911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b1f1e-2b75-4c0d-84c8-fd979b26f461 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:41.965075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:41.965515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:41.965797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:41.966074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:41.967222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:41.969761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:41.971573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 68/129] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:41.972140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.013381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.014644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.015119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.015616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.029359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:42.035323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:42.037810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:42.039288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:42.040188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:42.041595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 62/130] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:42.041694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.103941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29a8ba-e794-42a2-b4c8-df6a035fd311 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.147208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f482-c39f-4454-a123-d6899e6e6765 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.149621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.150552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.151029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.151495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/0f93f4121d434aed821124eb6820eb0b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.156901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, user_id=0f93f4121d434aed821124eb6820eb0b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.158879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.169258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:42.184702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.185611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.186001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.186386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.191562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.191562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.191562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 63/131] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:42 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:42.192241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.192538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 69/132] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:41 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/0f93f4121d434aed821124eb6820eb0b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:42.200945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.356198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42085fb9-94c0-4dea-b1aa-2df2b54d26af None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.384699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226cfe-cb74-42c3-ba9f-d248f9bba83a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.395945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:42.422048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.422751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.423034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.423308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/00c756b5256046849a97e0014acf510b/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.424899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.425587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.425691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, user_id=00c756b5256046849a97e0014acf510b, role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.425874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.426149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.426830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:42.427137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.427953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.428544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b182a8-54ad-48ac-b0c7-990aae4ddd8a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.446102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 64/133] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:42.447717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edf09-fb6b-4ef3-90cc-087b496dfb64 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.448343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edf09-fb6b-4ef3-90cc-087b496dfb64 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.450825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7edf09-fb6b-4ef3-90cc-087b496dfb64 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.452659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 65/134] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:42.453925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 70/135] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:42 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/00c756b5256046849a97e0014acf510b/roles/599414de16304217a39bf1ab5b7d8724 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:42.454986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.464860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.465411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.465823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.508897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:42.510996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:42.607924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:42.650344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 66/136] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:42.665984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14b59-6feb-4ab2-8d26-a43b90ea4e7c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.709749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.710626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.711663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.712081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.713371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.714969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.716730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 71/137] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:42 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:42.723617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.839049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603818f-f43e-44ce-bcdc-6ab6ae2a6459 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:42.874304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:42.874860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.875138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.875411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] PATH_INFO: `/v3/projects/72061eebe2234509bcbfd97e42a2efe3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.876609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] RBAC: Authorizing `identity:get_project(project_id=72061eebe2234509bcbfd97e42a2efe3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:42.878044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f6c3c-7139-41ac-a200-9932c8d0982b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:42.879979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 67/138] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:42 2022] GET /identity/v3/projects/72061eebe2234509bcbfd97e42a2efe3 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:42.885859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:42.905097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f98d-227e-4884-bb1d-e10b0f2b370e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.905388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f98d-227e-4884-bb1d-e10b0f2b370e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.905645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f98d-227e-4884-bb1d-e10b0f2b370e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.907122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 68/139] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:42.912251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:42.912535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:42.912805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:42.930702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:42.931924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:42.968437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:42.977046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:43.009819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 69/140] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:43.092458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95970462-d5a0-4e10-8dd7-aedd56db97ae None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:43.128972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:43.141432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:43.142097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:43.142375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:43.142656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] PATH_INFO: `/v3/projects/72061eebe2234509bcbfd97e42a2efe3/users/00c756b5256046849a97e0014acf510b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:43.144607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] RBAC: Authorizing `identity:create_grant(project_id=72061eebe2234509bcbfd97e42a2efe3, user_id=00c756b5256046849a97e0014acf510b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:43.146054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:43.167258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 72/141] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:42 2022] PUT /identity/v3/projects/72061eebe2234509bcbfd97e42a2efe3/users/00c756b5256046849a97e0014acf510b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:43.258966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc28ad-1c50-4862-a403-294b2d1970d0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:43.300390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:43.301040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:43.301385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:43.301687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:43.302840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:43.304392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:43.306794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 70/142] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:43.312160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:43.424027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b913099-2d8a-4180-9ce8-2b5d0007179e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:43.426531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:43.462919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:43.463833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:43.464172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:43.464438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:43.465083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:43.466661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:43.493493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 73/143] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:43 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:43.639963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:43.693681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:43.751015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a894d-74e1-460b-8ddf-03bf0c5edbaf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:43.790571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:43.791206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:43.791485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:43.791781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:43.806210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:43.810982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:43.811849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:43.812621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 71/144] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:43.817976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:43.983961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e43a8-c15d-404f-bb93-baabf7423576 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:44.028624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:44.029234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.029510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.029816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.030491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:44.030791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:44.032254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:44.044397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 74/145] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:44.052644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:44.188803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a39f-d5c9-4b20-b0c1-d57ff4a5cdb7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:44.191165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:44.233419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:44.234122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.234354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.234628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] PATH_INFO: `/v3/users/b673e684457b45b69eb6a9583d38ed46` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.235818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b673e684457b45b69eb6a9583d38ed46)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:44.237373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:44.239117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 72/146] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:44 2022] GET /identity/v3/users/b673e684457b45b69eb6a9583d38ed46 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:44.244605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:44.279573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:44.415634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226a86-6f93-4371-9622-8fb49655bbc2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:44.463342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:44.464023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.464305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.464580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.465770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:44.467216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb1a62-6c2e-4353-ab27-eb7bad06fd09 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:44.469922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 75/147] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:44 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:44.480617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:44.614049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219582-47d9-43d6-9815-9fd7468ba1f0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:44.662561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:44.663322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.663503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.663799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/b673e684457b45b69eb6a9583d38ed46/roles/261207a96b1d4ffe94bbaf70881114f1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.668866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, user_id=b673e684457b45b69eb6a9583d38ed46, role_id=261207a96b1d4ffe94bbaf70881114f1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:44.670325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31263b-2623-479e-91ce-f5545a41c60c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:44.698355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 73/148] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:44 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/users/b673e684457b45b69eb6a9583d38ed46/roles/261207a96b1d4ffe94bbaf70881114f1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:44.851400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba069aa7-2a0f-426e-b4e0-d357a5703224 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.852018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba069aa7-2a0f-426e-b4e0-d357a5703224 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.852018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba069aa7-2a0f-426e-b4e0-d357a5703224 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.853630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 76/149] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:44.859457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3633e-4b87-4dc8-b050-56460c3991c3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:44.859726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3633e-4b87-4dc8-b050-56460c3991c3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:44.859959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3633e-4b87-4dc8-b050-56460c3991c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:44.889243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6ec3633e-4b87-4dc8-b050-56460c3991c3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:44.890466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ec3633e-4b87-4dc8-b050-56460c3991c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:44.922290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:44.984546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 74/150] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:45.059845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5f93-4267-4265-9b37-1ba5846c5098 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.060174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5f93-4267-4265-9b37-1ba5846c5098 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.060397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5f93-4267-4265-9b37-1ba5846c5098 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.062009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 77/151] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:45.067079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.067359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.067677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.092585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:45.093803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:45.124485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4527a-fd30-49f0-bc98-2a2a3bd36d01 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.124713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4527a-fd30-49f0-bc98-2a2a3bd36d01 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.124958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4527a-fd30-49f0-bc98-2a2a3bd36d01 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.126435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 78/152] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:45.131496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.131798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.132072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.161113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:45.162330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:45.209640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 75/153] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:45.259330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 79/154] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:45.458953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:45.576039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:45.584845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa505cf-f073-4534-a847-bf825851df94 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:45.633195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:45.633833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.634114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.634382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.649291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:45.654670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:45.655523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:45.660643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:45.662724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 76/155] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:45.669701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:45.704685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:45.767288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:45.827335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950138c-3f91-4e13-92d1-b2e41ca6f1ef None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:45.905466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:45.907699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:45.908326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:45.909370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:45.910407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:45.913084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:45.914737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:45.932015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 80/156] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:45.940387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:45.985244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c8c4-0648-4174-a05e-b469b1b2d878 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.048881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.049881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.051450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.051962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.075579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:46.081551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:46.082404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:46.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:46.087882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:46.088120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 77/157] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:24:46.088963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:46.121549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:46.134291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b254-a16b-49f9-989a-87423f836ea7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.201045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.201688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.201963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.202231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] PATH_INFO: `/v3/users/0f93f4121d434aed821124eb6820eb0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.203680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] RBAC: Authorizing `identity:get_user(user_id=0f93f4121d434aed821124eb6820eb0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:46.205129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:46.206712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 81/158] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:45 2022] GET /identity/v3/users/0f93f4121d434aed821124eb6820eb0b => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:46.211777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:46.306362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9524-440c-4d26-b6f3-e67e4c8f6e94 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.365895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f9c78-3b16-43bc-ae75-2a57af21809d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.414658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.415699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.416194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.416658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.420220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.420854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.421132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.421398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.422068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:46.422366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:46.424094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:46.443388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 82/159] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:46.444445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:46.444687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:46.450311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:46.451257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:46.452113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:46.454862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 78/160] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:46.459822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:46.470955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:46.642841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:46.669276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87f5f-cb75-4efd-8745-bd011d1f85d6 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.682203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a2153-ee5a-4645-9dd1-fdaf6eb95745 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.736245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.736864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.737143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.737468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.744912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.745197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.745473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.746684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:46.748166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:46.750090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 79/161] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:46 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:46.750861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:46.860080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:46.861742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b90d0-3221-4991-a940-5d1b6f9d897d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:46.874806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:46.919112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa113e1f-39ed-4170-9a8b-772a5cc1a6c5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:46.997994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:46.998607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:46.998879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:46.999147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:46.999841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:47.000142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.001553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.013466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 80/162] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:47.014362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:47.022790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:47.046110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 83/163] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:47.047385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fe01-462a-41a9-b069-908c157e0ad0 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.047695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fe01-462a-41a9-b069-908c157e0ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.047969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fe01-462a-41a9-b069-908c157e0ad0 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.049332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 84/164] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:47.049892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fe01-462a-41a9-b069-908c157e0ad0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:47.210281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f7f95-dc85-4f68-bf8f-6320c5f4ba84 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:47.274698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:47.275708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.276207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.276738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.324368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fe01-462a-41a9-b069-908c157e0ad0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:47.333915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:47.396262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:47.396906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.397177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.397439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.398635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.400124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.401881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 85/165] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:47.402459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:47.413776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.416277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f4715-f441-4cd6-bc09-ad50e22ee64c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.418920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:47.586166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d0b30-6100-4140-bf76-35720b459853 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:47.602768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 81/166] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:47.604092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409ba2-2d59-415a-bad8-3ae079af2c21 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.604378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409ba2-2d59-415a-bad8-3ae079af2c21 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.604649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409ba2-2d59-415a-bad8-3ae079af2c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.638129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c2409ba2-2d59-415a-bad8-3ae079af2c21 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:47.639317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c2409ba2-2d59-415a-bad8-3ae079af2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:47.655426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:47.656096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.656372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.656645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.659786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.661261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.662921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:47.663710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:47.713423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:47.779779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337215c-d69f-48e1-b2e4-6f7934593e79 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:47.806093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 82/168] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:47.807360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13868d6-e1b1-4cc0-8f3e-2a25538a8e84 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.807662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13868d6-e1b1-4cc0-8f3e-2a25538a8e84 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.807932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13868d6-e1b1-4cc0-8f3e-2a25538a8e84 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.809322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 83/169] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:47.809854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13868d6-e1b1-4cc0-8f3e-2a25538a8e84 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:47.852871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:47.853405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.853686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.853947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.854044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:47.928013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13868d6-e1b1-4cc0-8f3e-2a25538a8e84 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:47.945473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.946939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7441-f65d-452a-bfad-214547a280f2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.965466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:47.966369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:47.966955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:47.967401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:47.968719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:47.970459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:47.972372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:47.973305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.023391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.080548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751fc3-61c2-4a21-9882-f85b61185622 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.083905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.090047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 87/171] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:48.090782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26636a7d-b03f-4bc6-8846-935169049053 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.091058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26636a7d-b03f-4bc6-8846-935169049053 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.091325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26636a7d-b03f-4bc6-8846-935169049053 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.096986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 88/172] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:48.098079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702252-68b3-4ddf-8d9d-2066cf4c4c6a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.098357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702252-68b3-4ddf-8d9d-2066cf4c4c6a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.098618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702252-68b3-4ddf-8d9d-2066cf4c4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.120497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.121411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.121867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.122308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.123253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=0f93f4121d434aed821124eb6820eb0b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:48.123790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:48.125392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:48.131564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 85/173] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:47 2022] GET /identity/v3/role_assignments?user.id=0f93f4121d434aed821124eb6820eb0b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:48.132542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.140752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-be702252-68b3-4ddf-8d9d-2066cf4c4c6a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:48.141966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-be702252-68b3-4ddf-8d9d-2066cf4c4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:48.242605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ca5c-569c-47d9-a53d-d7846f8c942c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.260887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 89/174] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:48.262163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b602513-206c-4219-a627-cb0ff828780a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.262443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b602513-206c-4219-a627-cb0ff828780a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.262712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b602513-206c-4219-a627-cb0ff828780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.299582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.300560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.300665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7b602513-206c-4219-a627-cb0ff828780a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:48.301243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.301709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.301810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7b602513-206c-4219-a627-cb0ff828780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:48.302726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:48.303238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:48.305242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:48.324590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 86/175] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=599414de16304217a39bf1ab5b7d8724 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:48.325909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.383975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.417220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 90/176] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:48.418097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b602513-206c-4219-a627-cb0ff828780a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.420572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.510343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279334-9586-4587-bdb9-6e85a6453636 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.537407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b602513-206c-4219-a627-cb0ff828780a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.579441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.580095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.580368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.580634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.592865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-157b9739-b723-48ba-a0dc-0356ed1363fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:48.597726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:48.598624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:48.599445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:48.600082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.600170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 91/177] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:48.600236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.600236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.600236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.601166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84233a-7d2c-459a-afd6-d3eb7d1bdf42 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.601166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84233a-7d2c-459a-afd6-d3eb7d1bdf42 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.601320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:48.601388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84233a-7d2c-459a-afd6-d3eb7d1bdf42 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.602876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 92/178] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:48.603850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911934cc-0b20-4112-822c-0cc4ce63bd65 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.603850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911934cc-0b20-4112-822c-0cc4ce63bd65 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.604007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911934cc-0b20-4112-822c-0cc4ce63bd65 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.605344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 93/179] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:48.605700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aca7b-9d62-4057-8076-a9190250b405 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:48.610971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 87/180] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:48.612450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.612731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.612999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.614780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.615064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.615337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.637432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:48.637845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:48.638612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:48.638996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:48.704806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.719992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 94/181] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:48.720929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.723231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 88/182] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:48.724821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.765153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:48.840820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb175d-ae7a-4de2-9a22-8873cbd2a7e7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.876928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.877670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.878013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.878413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.879138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:48.879509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:48.880976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:48.885339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4d17-487d-4426-bdba-8cdbe2855db5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:48.894841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 95/183] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:48.894841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.925997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:48.926995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:48.927285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:48.927581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:48.928451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:48.928868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:48.930597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:48.938081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 89/184] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:48.938859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:48.959347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.010292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466249d6-d2d0-43c5-b892-5187e7689a19 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.057003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.057679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.057955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.058222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.073722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:49.081524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:49.082541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:49.083388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 96/185] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:49.087958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.089524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.095639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33e014-d75a-47c4-a7ea-4d07c8c8a241 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.141534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.142166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.142441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.142710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.156954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:49.162119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:49.163042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:49.164204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 90/186] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:49.165213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.209937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354b19-6b4f-467e-b674-50a2bcd1ef6a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.223412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.243785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.244411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.244686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.244955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] PATH_INFO: `/v3/users/00c756b5256046849a97e0014acf510b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.246083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] RBAC: Authorizing `identity:get_user(user_id=00c756b5256046849a97e0014acf510b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.247523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.249114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 97/187] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/users/00c756b5256046849a97e0014acf510b => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.249868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.268820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1aef1-e876-427e-94ef-13baf036db3f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.302048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.302675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.302952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.303225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.314285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:49.319069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:49.320087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 91/188] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:49.321523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.333531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.352618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e534c3-e4c6-44f8-ad12-592e2ae5cbb7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.386121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.386719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.386992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.387259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.387955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:49.388253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.389611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.397391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 98/189] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.398164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.421341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c220-7be0-43e7-a8de-f6554ebf3ad2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.446430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.456017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.456634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.456914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.457182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.458272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.459817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.461363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 92/190] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.462178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.501672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477a8b-311a-44c4-8ca7-a292690bd7e9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.536470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.537073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.537349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.537623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.538290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:49.538561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.538671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.540000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.547936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 99/191] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.548715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.564694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8c3fe-0056-4c2f-b7b3-6ac06c9d71bf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.598421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.599026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.599302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.599657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.646018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b270-92f4-47d0-ad44-75c05bb02d0c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.653165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.670035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.671584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.681294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.681893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.682167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.682434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.683090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:49.683387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.684768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.692424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 100/192] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.693184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.747266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.769904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 93/193] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:49.770784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.801229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f506db-bc9e-418f-a06f-8f78b22a40a1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.834910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.835584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.835865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.836153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.849098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.850563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.852774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 101/194] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:49.853524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.866253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db60b4-5c44-41d0-8ba2-3d094d674b84 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.879588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.901872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.902472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.902747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.903019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.903688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:49.905133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:49.925852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 94/195] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:49 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:49.926585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:49.956949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee849-d6d5-4c5c-8d30-475076fae1bc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:49.979464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:49.996590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:49.997236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:49.997510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:49.997794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] PATH_INFO: `/v3/users/b673e684457b45b69eb6a9583d38ed46` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:49.998953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] RBAC: Authorizing `identity:get_user(user_id=b673e684457b45b69eb6a9583d38ed46)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.000443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.002091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 102/196] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/users/b673e684457b45b69eb6a9583d38ed46 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:50.002091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.065048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8583-c181-4684-ae28-f06e348344bd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.107505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.108406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.108682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.108952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.110088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.111511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.113954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 95/197] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:49 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:50.114336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.115963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.127888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611ec43-6f47-4653-8a30-bb76e316aa43 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.173353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.173997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.177303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.177303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] PATH_INFO: `/v3/projects/72061eebe2234509bcbfd97e42a2efe3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.177303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] RBAC: Authorizing `identity:get_project(project_id=72061eebe2234509bcbfd97e42a2efe3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.177550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.179042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 103/198] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/projects/72061eebe2234509bcbfd97e42a2efe3 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:50.179900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.233577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337cf3-7bf0-4fe3-9483-b85b6c5bd38a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.235191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.271531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.272542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.272824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.273096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.313484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ad3c-4299-4fcb-836d-f4711362f289 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.347714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.349535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.352264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.353349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.353349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.353548 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.387793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.430208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.431712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.453143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 96/199] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:50.454283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.456806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.559763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:50.560630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.561666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234cae-9be1-474e-b9b3-5fdcc36d5842 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.611649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.612587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.613056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.613509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.639628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.690718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b24e-4d93-4785-8bf0-3053a584a003 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.700090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.701984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.704627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.737975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.738955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.739454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.739943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.740863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=72061eebe2234509bcbfd97e42a2efe3, user.id=00c756b5256046849a97e0014acf510b) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:50.741369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.743587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.749837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 105/201] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/role_assignments?user.id=00c756b5256046849a97e0014acf510b&scope.project.id=72061eebe2234509bcbfd97e42a2efe3&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:50.750856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.845086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 97/202] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:50.845811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:50.878367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a588223-8cb2-4c9d-9cd7-f8cf191d7176 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:50.927856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:50.946902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:50.947908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:50.948381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:50.948842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:50.950401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:50.952128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:50.956841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 106/203] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:50.958639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:51.015470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b721-2248-432c-a681-f52aa0b1ef77 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:51.017695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:51.054746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:51.055965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:51.056244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:51.056516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:51.060230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:51.064325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:51.066307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 98/204] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:51.068028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:51.083054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437103c-9a89-499e-a228-581828b71fdf None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:51.125453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:51.126090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:51.126362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:51.126629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:51.127920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:51.129393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:51.131173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 107/205] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:50 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:51.136543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:51.209096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f775105-70dd-42c4-9568-8fda88cbf581 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:51.227585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:51.249469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:51.250445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:51.250928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:51.251411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:51.252396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=37dbdda0f565427d877d108121cf64a3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:51.252911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:51.254556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:51.260900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 99/206] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:51 2022] GET /identity/v3/role_assignments?user.id=37dbdda0f565427d877d108121cf64a3&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:51.261918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:51.292900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8284-4c80-4b62-b42e-672dbadf0d1d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:51.336264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:51.373017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370994-c11d-433c-8151-026b03db53bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:51.374407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370994-c11d-433c-8151-026b03db53bc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:51.375022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370994-c11d-433c-8151-026b03db53bc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:51.376939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370994-c11d-433c-8151-026b03db53bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:51.378025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370994-c11d-433c-8151-026b03db53bc None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6, user.id=b673e684457b45b69eb6a9583d38ed46) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:51.378567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370994-c11d-433c-8151-026b03db53bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:51.381035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370994-c11d-433c-8151-026b03db53bc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:51.393722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 108/207] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:51 2022] GET /identity/v3/role_assignments?user.id=b673e684457b45b69eb6a9583d38ed46&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:51.456037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c7bf-b2d8-4e1f-a8f4-541fab7f1855 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:51.501474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:51.502485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:51.502965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:51.503456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:51.504448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=37dbdda0f565427d877d108121cf64a3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:51.504986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:51.506687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcae63-bffe-4d47-a23f-dc33a44f5e63 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:51.516002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 100/208] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:51 2022] GET /identity/v3/role_assignments?user.id=37dbdda0f565427d877d108121cf64a3&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=599414de16304217a39bf1ab5b7d8724 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:52.074038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ef5f-2794-4360-b516-f1b795f2f9c9 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.074430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ef5f-2794-4360-b516-f1b795f2f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.074620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ef5f-2794-4360-b516-f1b795f2f9c9 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.076136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 109/209] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:52.081384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb0fe-c3b2-4fea-9e29-d443f3037c98 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.081816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb0fe-c3b2-4fea-9e29-d443f3037c98 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.081999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cb0fe-c3b2-4fea-9e29-d443f3037c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.100140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bf0cb0fe-c3b2-4fea-9e29-d443f3037c98 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:52.101378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf0cb0fe-c3b2-4fea-9e29-d443f3037c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:52.173647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 101/210] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:52.193005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dc260-969b-48a3-9b99-ab18ab78bc2f None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.193290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dc260-969b-48a3-9b99-ab18ab78bc2f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.193547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dc260-969b-48a3-9b99-ab18ab78bc2f None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.195014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 110/211] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:52.200315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.200815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.201298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.220119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:52.221567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:52.245392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:52.293355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:52.447027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dc260-969b-48a3-9b99-ab18ab78bc2f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:52.555094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dc260-969b-48a3-9b99-ab18ab78bc2f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:52.565779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:52.582829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:52.595913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:52.596557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.596836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.597105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.618182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:52.623328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:52.624407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:52.625412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:52.627352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 111/213] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:52.637064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:52.705770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3b640-c980-4dfc-9c2d-abb08cdc16d3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:52.749050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:52.750473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.750982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.751735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.753219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:52.755385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:52.757946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 103/214] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:52.762745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4ca7-72a1-46e4-8ce3-01931e71efa9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:52.763835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:52.799856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:52.808601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:52.809444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.809728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.809996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.810663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:52.811662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:52.816046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:52.831675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 112/215] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:52.834525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:52.898556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:52.901931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aebe4-9215-4618-88ed-3e7f57a6cc32 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:52.949404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:52.950036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:52.950307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:52.950617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:52.951286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:52.953097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:52.966721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbcecc-0a0b-4aa0-8703-2c1ea751f25d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:52.982687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 104/216] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:52 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:24:53.014284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:53.015213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.015687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.016117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] PATH_INFO: `/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.034624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] RBAC: Authorizing `identity:get_user(user_id=2e2c242e3ab84c30bf5ea5e98a5032bc)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:53.036651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc883-cc64-411b-b85f-71bb1b57ca6a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:53.039244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 113/217] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:52 2022] GET /identity/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:53.045371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:53.143815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:53.166350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0859-a841-44a1-97f5-832ff966e47e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:53.202678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:53.203591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.203859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.204135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.274411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:53.275831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:53.361342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:53.378946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d378-ba82-4f7d-a50c-f5519ebfbc75 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.379258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d378-ba82-4f7d-a50c-f5519ebfbc75 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.379493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d378-ba82-4f7d-a50c-f5519ebfbc75 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.380870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 114/218] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:53.388166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b6244-3640-4782-956b-1fc474da167c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.388316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 105/219] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:53.388812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b6244-3640-4782-956b-1fc474da167c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.389250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b6244-3640-4782-956b-1fc474da167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.393541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:53.415294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b83b6244-3640-4782-956b-1fc474da167c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:53.416844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b83b6244-3640-4782-956b-1fc474da167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:53.507156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 115/220] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:53.521443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc50d4-9656-4265-9d1f-c5e9f5c59d3b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:53.563254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:53.564253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.564729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.565195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.570376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:53.572694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18724ce-d10b-43cc-8bd6-23eae88fa255 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:53.574958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 106/221] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:53 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:53.580742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b6244-3640-4782-956b-1fc474da167c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:53.591646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61f26-f985-475a-9be3-1264fdb038e8 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.592280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61f26-f985-475a-9be3-1264fdb038e8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.592790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61f26-f985-475a-9be3-1264fdb038e8 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.594321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 107/222] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:53.599950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.600474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.600953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.628077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:53.631776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:53.633591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:53.714221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:53.751129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b6244-3640-4782-956b-1fc474da167c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:53.751800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 108/223] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:24:53.803287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:53.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:53.804241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:53.804506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:53.805769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=2e2c242e3ab84c30bf5ea5e98a5032bc) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:53.806069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:53.807497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:53.820173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 116/224] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:53 2022] GET /identity/v3/role_assignments?user.id=2e2c242e3ab84c30bf5ea5e98a5032bc&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:53.873065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.002303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7a2f-7dc5-4322-a396-62ee4c101fe3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.047623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.048645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.049121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.049586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.056614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.081058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:54.087612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:54.088568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:54.089366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:24:54.090542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 109/225] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:54.096590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.171888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:54.216751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe6b38-caac-4637-bd4c-0677f38368b9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.231759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:54.233304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f965a9-6b5e-4ed1-b303-6db46acb8de4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.286524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.288677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.290841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.291318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.302386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.304178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.306360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.306847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.307731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:54.308954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:54.310520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:54.314832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:54.320042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:54.320953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:54.321741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:54.329154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 117/226] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:24:54.330591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.336648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 110/227] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:54.342474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.491062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8273aa6-1203-4090-8992-bc3fba6c94ae None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.527732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0bc9b-1e75-4b37-b701-6a327c2a384d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.533502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:54.561891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.563520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.563823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.564095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.564787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:54.565091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:54.566530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:54.592094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 118/228] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:54.597667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.611572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.615575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.615575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.615575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.615575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:54.616951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:54.618575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 111/229] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:54.638955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.650615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:54.750339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a14a36-1f4a-4bc6-8500-eef1b287f068 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.796291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.796932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.797207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.797479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.799375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:54.800858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:54.802597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 119/230] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:54.808475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.832081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9223d-4871-4b5c-b405-ce56913e02a6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.874447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.874998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.875270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.875557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:54.878810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:54.880288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:54.882103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 112/231] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:54.888734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:54.959506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df53f5-dff1-45f8-baf8-0d91711c6a0c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:54.971740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:54.997774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:54.998513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:54.998861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:54.999206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.000449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:55.001968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:55.003894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:55.004945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 120/232] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:54 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:55.014559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:55.131525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24148a8-abd5-4704-a5f2-74c4802767ef None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:55.151626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845b5a2-4b32-413a-b29b-afb25e591c9a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:55.186971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:55.187991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.188411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.188820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/37dbdda0f565427d877d108121cf64a3/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.196870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user_id=37dbdda0f565427d877d108121cf64a3, role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:55.198482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30994b1-cd34-4c2e-8e94-0880734d91d5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:55.219908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:55.220675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 121/233] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:55 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/37dbdda0f565427d877d108121cf64a3/roles/599414de16304217a39bf1ab5b7d8724 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:55.220781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.220964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.221234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/37dbdda0f565427d877d108121cf64a3/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.223416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user_id=37dbdda0f565427d877d108121cf64a3, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:55.225385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9dd99-75b5-4435-8868-a82bb13e40da None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:55.252820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 113/234] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:54 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/37dbdda0f565427d877d108121cf64a3/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:24:55.363726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2fee-c439-4541-85f9-be8a74084432 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.364418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2fee-c439-4541-85f9-be8a74084432 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.364920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee2fee-c439-4541-85f9-be8a74084432 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.366554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 122/235] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:55.372972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49368ee9-73de-407a-ae62-d7ab57f4cd0c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.373559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49368ee9-73de-407a-ae62-d7ab57f4cd0c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.374029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49368ee9-73de-407a-ae62-d7ab57f4cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.397824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-49368ee9-73de-407a-ae62-d7ab57f4cd0c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:55.399420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-49368ee9-73de-407a-ae62-d7ab57f4cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:55.481063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 114/236] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:55.527157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c875e7-271e-40f7-b936-6e54fce873b7 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.527468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c875e7-271e-40f7-b936-6e54fce873b7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.527854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c875e7-271e-40f7-b936-6e54fce873b7 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.529377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 123/237] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:55.534682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:55.535193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:55.535735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:55.555479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:55.557034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:55.588822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:55.651064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 115/238] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:55.858620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c875e7-271e-40f7-b936-6e54fce873b7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:55.880325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:55.992329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c875e7-271e-40f7-b936-6e54fce873b7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.009409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.052077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.053723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.054377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.055959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.075525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:56.080806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:56.081702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:24:56.082512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:56.088416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 124/239] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:56.094373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.199362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af2b0-5e32-4cbd-a2e3-ea21e954db29 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.240019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:56.255765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.257291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.258069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.258573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.259896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:56.261689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:56.263603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 116/240] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:56.271449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.295616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60f0ac-a5c1-4e6f-b3e9-bcf0e27f4210 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.308463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:56.345118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.345727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.346007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.346472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.347086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:56.347722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:56.348903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611766d5-47ad-444e-865f-fe3402cce62f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:56.357773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 125/241] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:56.358962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1b5f-10d5-4277-85ce-c27adda04f5f None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.359246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1b5f-10d5-4277-85ce-c27adda04f5f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.359519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1b5f-10d5-4277-85ce-c27adda04f5f None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.365159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 126/242] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:56.365957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d1b5f-10d5-4277-85ce-c27adda04f5f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.401980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a87ab-0ab8-4e5f-8e98-dbe8bbb9c34c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.444775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.446151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.446624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.447050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.447870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:56.449439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd7c9c-1dcf-482f-a747-4ce7a3fad386 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:56.480458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d1b5f-10d5-4277-85ce-c27adda04f5f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.480715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 117/243] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:24:56 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:24:56.482215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.482644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.483112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.505441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:56.507204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:56.564113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.564824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.565104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.565373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] PATH_INFO: `/v3/users/967e687da436478b982778ebe8b3f69d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.589633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:56.598127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] RBAC: Authorizing `identity:get_user(user_id=967e687da436478b982778ebe8b3f69d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:56.599009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 118/244] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:56.604411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:56.604411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 127/245] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/users/967e687da436478b982778ebe8b3f69d => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:56.612331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.640355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:56.764264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f91b0-fcce-4602-8812-64043786fb3f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:56.798830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:56.799695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:56.800117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:56.800600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:56.870522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:56.872280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:56.887001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:56.908161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:56.988850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 119/246] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:56.994651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.036860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129a01a-5197-4460-ac10-d7048560eb47 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.082183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.083171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.083685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.084176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.097479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:57.105284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:57.106285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:24:57.107115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:57.109699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 128/247] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:24:57.115881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.116702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127ab1-d1e5-479c-a22f-9db8daeeac67 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.134192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:57.167315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.168406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.168913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.169380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.170788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.172470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.174861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 120/248] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:56 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:57.181608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.200754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:57.267811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f050bb1-ec9b-451c-8a91-9d2ffec7cd6c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.318104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.318648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.318929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.319199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.319900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:57.320204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.321767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.328562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed697-5d66-4380-ab49-b7c70f685f2b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.336968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 129/249] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:57.338697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.378060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.378709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.379248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.379563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.380359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=967e687da436478b982778ebe8b3f69d) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:57.381038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.383011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a749-efc3-443f-805f-3a4480ed7f0c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.391521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 121/250] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:57 2022] GET /identity/v3/role_assignments?user.id=967e687da436478b982778ebe8b3f69d&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:57.473616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a800-f172-4f09-8182-26b50208a9d1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.479348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff801d-c3b2-421b-9bc7-8f9052fb37e7 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.479840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff801d-c3b2-421b-9bc7-8f9052fb37e7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.480194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff801d-c3b2-421b-9bc7-8f9052fb37e7 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.482016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 122/251] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:24:57.487636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650342d-56d2-42f8-a31c-6d1ce544889d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.487989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650342d-56d2-42f8-a31c-6d1ce544889d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.488363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650342d-56d2-42f8-a31c-6d1ce544889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.499721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:57.516157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.518339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.518815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.519268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] PATH_INFO: `/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.520822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] RBAC: Authorizing `identity:get_user(user_id=2e2c242e3ab84c30bf5ea5e98a5032bc)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.522620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.526308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 130/252] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:57 2022] GET /identity/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:57.531661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.548711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7650342d-56d2-42f8-a31c-6d1ce544889d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:57.549963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7650342d-56d2-42f8-a31c-6d1ce544889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:57.618024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:57.651351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56479-9a5d-4c16-9d93-4783fd7a6d0d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.662206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 123/253] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:57.688398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.689391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.689903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.690370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.692025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.693144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68e3e-ac27-4368-bd5f-9a991d2ea8f0 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.693432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68e3e-ac27-4368-bd5f-9a991d2ea8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.693709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68e3e-ac27-4368-bd5f-9a991d2ea8f0 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.694375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b645d-26d1-4f18-a973-bbf585447ce6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.695182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 124/254] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:57.697462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 131/255] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:57 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:57.702622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68e3e-ac27-4368-bd5f-9a991d2ea8f0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:57.715270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.715906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.716392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.748589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:57.750143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:57.816387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68e3e-ac27-4368-bd5f-9a991d2ea8f0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:57.834184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:57.856962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:57.857628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:57.857909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:57.858185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/2e2c242e3ab84c30bf5ea5e98a5032bc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:57.860398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user_id=2e2c242e3ab84c30bf5ea5e98a5032bc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:57.861786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:57.869427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 132/256] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:24:57.885978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 125/257] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:24:57 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/2e2c242e3ab84c30bf5ea5e98a5032bc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:24:58.056515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.165298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a895-7a11-4771-ad85-bcf571f7bcfd None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:58.209635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:58.210631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:58.211112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:58.212135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:58.223505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:58.229201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:58.230086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:24:58.230886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:58.233423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 133/258] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:58.239752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.303920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:58.380420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca735eb-eaeb-49b5-93af-2d7b94980e97 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:58.396763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.424473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:58.425010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:58.425289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:58.425560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:58.426363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:58.426673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:58.428078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:58.442636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 126/259] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:58.452579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.522890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:58.557188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:58.561612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af923823-a56b-4320-8ef5-19029cf9cebe None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:58.598683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:58.599329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:58.599650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:58.599930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:58.601096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:58.602665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:58.604614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 127/260] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:58.609807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.671766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfa42-ee73-477c-91b8-cc83c92a3473 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:58.749102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:58.749666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:58.749937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:58.750205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:58.778327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:24:58.784720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:24:58.785739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:24:58.786563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 134/261] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:24:58.794612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:58.824256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d304-ebe8-48e3-939e-96b756db8536 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:58.902047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:58.902635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:58.902908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:58.903175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:58.972715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:59.014072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.015496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.043731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b3a9-52d1-46fb-a50c-88b7409640e7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:59.051839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:59.108474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:59.109101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.109362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.109638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.110544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:59.110884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.112500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.131324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 135/262] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:59.143918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:59.205386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 128/263] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:24:59.210951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:59.317715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:59.364707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d28e-0d42-4866-b52d-335727fd7e5c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:59.376455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e5ad-c1de-428e-8707-fc7bf99f6b14 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:59.426785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:59.426992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:59.427411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.427732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.428011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] PATH_INFO: `/v3/users/37dbdda0f565427d877d108121cf64a3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.428769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.429249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.429350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=37dbdda0f565427d877d108121cf64a3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.429802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.433724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.434596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.436285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.436753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 136/264] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:24:59 2022] GET /identity/v3/users/37dbdda0f565427d877d108121cf64a3 => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:24:59.438684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 129/265] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:24:59 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:59.442583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:59.444449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:24:59.546343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:59.671497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753881b-6e24-4da3-92fb-9fbf1d1dab63 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:59.704560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4ed6-86f7-4d29-b033-728ac5909ff0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:24:59.738473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:59.739089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.739369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.739675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.740801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=37dbdda0f565427d877d108121cf64a3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:24:59.741124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.742767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227653-8aaf-4c22-b80f-9c2b3ba79960 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.755927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:24:59.763599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 130/266] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:24:59 2022] GET /identity/v3/role_assignments?user.id=37dbdda0f565427d877d108121cf64a3&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=599414de16304217a39bf1ab5b7d8724 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:24:59.792753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:24:59.793397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.793677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.793952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.899881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:24:59.901398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:24:59.917979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a0a9-48a3-49d8-b118-98986b522d04 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.918289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a0a9-48a3-49d8-b118-98986b522d04 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.918544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4a0a9-48a3-49d8-b118-98986b522d04 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.920290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 131/267] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:24:59.926637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eaafd-bc0f-4664-8b64-e72d2f3c9388 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:24:59.927051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eaafd-bc0f-4664-8b64-e72d2f3c9388 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:24:59.927426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eaafd-bc0f-4664-8b64-e72d2f3c9388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:24:59.954235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-122eaafd-bc0f-4664-8b64-e72d2f3c9388 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:24:59.955447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-122eaafd-bc0f-4664-8b64-e72d2f3c9388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:24:59.987419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.078941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 132/268] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:00.080247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811851e4-84a4-4f8a-a162-7ee85fbe1182 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.080528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811851e4-84a4-4f8a-a162-7ee85fbe1182 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.080802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811851e4-84a4-4f8a-a162-7ee85fbe1182 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.082046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 133/269] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:00.089228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3ac2-e309-4fdf-941c-506323ea6113 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.089505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3ac2-e309-4fdf-941c-506323ea6113 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.089779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3ac2-e309-4fdf-941c-506323ea6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.104081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 137/270] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:00.109844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.131813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3afb3ac2-e309-4fdf-941c-506323ea6113 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:00.133017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3afb3ac2-e309-4fdf-941c-506323ea6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:00.217560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 134/271] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:00.218748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1a21-006d-43a3-be05-bb3a063c97e5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.219028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1a21-006d-43a3-be05-bb3a063c97e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.219296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1a21-006d-43a3-be05-bb3a063c97e5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.220725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 135/272] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:00.225752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.226033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.226301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.244080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:00.245243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:00.246472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3812d-17fd-4105-86f7-70417a3424f2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.301898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.302870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.302982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.303231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.304131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.306140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:00.307651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:00.309389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 138/273] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:00.315852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.318355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 136/274] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:00.323858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.412484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.436361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b58c-c891-4767-9091-cd4fd78d9654 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.471825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.472665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.473085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.473495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.474364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=37dbdda0f565427d877d108121cf64a3) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:00.474824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:00.476504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:00.483226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 139/275] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/role_assignments?user.id=37dbdda0f565427d877d108121cf64a3&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:00.601873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f080d7b-bc42-4843-b550-7218577c8e9b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.653583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.654222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.654503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.654777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.665940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:00.670679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:00.670822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:00.671701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:00.672545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 137/276] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:00.677646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.740635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.760167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.797888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa465e-5cc7-48c7-bee3-2f4295800fc5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.804277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdb20-84c7-420f-ada1-3d3acae16743 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.835508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.836160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.836507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.836774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.839872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.840474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.840746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.841013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.841673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:00.841968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:00.843339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:00.847827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:00.851304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 138/277] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:00.852680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:00.854246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:00.855118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 140/278] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:00.857494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:00.959289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832ed4d-a500-48ff-b77f-a7117f44a1d9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.962431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde036b4-637d-4097-a385-1085e017fcb1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:00.971462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.985347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:00.994151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.994721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.994994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.995261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] PATH_INFO: `/v3/users/967e687da436478b982778ebe8b3f69d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.996423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=967e687da436478b982778ebe8b3f69d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:00.997575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:00.997876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:00.998235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:00.998511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:00.998781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:00.999427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 141/279] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/users/967e687da436478b982778ebe8b3f69d => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.002868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.002946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.003015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5d434-1224-49e0-99b7-92ab9fb431e1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.003015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 139/280] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.008606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58432378-377d-4d3d-a800-6f7aa82c8968 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.008878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58432378-377d-4d3d-a800-6f7aa82c8968 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.009142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58432378-377d-4d3d-a800-6f7aa82c8968 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.011348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 140/281] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:01.011348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58432378-377d-4d3d-a800-6f7aa82c8968 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.106037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94684-d21b-4558-8391-a24e7d5ce7d7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.110678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58432378-377d-4d3d-a800-6f7aa82c8968 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.138162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.138754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.139010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.139282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.139969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:01.140269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.141625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.143938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.144555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.144833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.145105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.146209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.147659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bd4f8-0704-4953-9e4c-90daecafdcd2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.149536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 142/282] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.150284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.154041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 141/283] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.154041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.154041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.154041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.171366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:01.172574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:01.210529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:01.212768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:01.239787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 142/284] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:01.240570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.261817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ee585-69f5-4593-a356-3210a9c4f07a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.302318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.302922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.303204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.303478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.304152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.305688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.329969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 143/285] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:01 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:01.331063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.345187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1a183-fe31-498f-8175-faba6c84c3d7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.386060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.386750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.387027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.387359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/967e687da436478b982778ebe8b3f69d/roles/261207a96b1d4ffe94bbaf70881114f1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.389528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user_id=967e687da436478b982778ebe8b3f69d, role_id=261207a96b1d4ffe94bbaf70881114f1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.391106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.416436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:01 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/users/967e687da436478b982778ebe8b3f69d/roles/261207a96b1d4ffe94bbaf70881114f1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:01.480027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a38e8a-4c9f-411b-91f4-f9adb24c2741 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.496412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:01.517512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.529074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.529492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.529765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.530035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] PATH_INFO: `/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.549491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] RBAC: Authorizing `identity:get_user(user_id=5fd74518c2bd4ab79d789fd3f8407d1f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.550988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.552976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.563387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.566488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:01.661863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785565c-e89f-469d-9701-e0842ed51542 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.707085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.707787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.708068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.708343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.716218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f54dcc-9919-422b-b12b-179e019e6410 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.721888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:01.729292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:01.730267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:01.731073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 144/288] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:01.736692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.760717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.761384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.761666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.761938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.762702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, user.id=5fd74518c2bd4ab79d789fd3f8407d1f, scope.system=all) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:01.762978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.764449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.770506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 145/289] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/role_assignments?user.id=5fd74518c2bd4ab79d789fd3f8407d1f&scope.system=all&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:01.858095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:01.866956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f2c4-6634-417f-a5a0-a85ac00c4788 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:01.907566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:01.908557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:01.909035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:01.909504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:01.910414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:01.910945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:01.912601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:01.923092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 145/290] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:01.928981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:01.968095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:02.037574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44fde-e6fe-4ab2-8d75-0636a05bdea4 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:02.075109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:02.076204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:02.076709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:02.077172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] PATH_INFO: `/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:02.078942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2c242e3ab84c30bf5ea5e98a5032bc)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:02.080648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:02.082844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 146/291] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:01 2022] GET /identity/v3/users/2e2c242e3ab84c30bf5ea5e98a5032bc => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:02.088757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:02.212610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975e6ee-569f-4e58-a458-6c4afb26f820 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:02.248676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:02.249672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:02.250161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:02.250638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:02.277587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:02.324920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:02.326702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:02.432022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:02.439669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:02.615341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7259bb-f8dd-4ad6-bb78-2096da76da11 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:02.618549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:02.660558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:02.661375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:02.661650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:02.661920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:02.665595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:02.667039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4641c-6dec-43d7-b6a2-988684181e66 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:02.669051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 147/293] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:02 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:02.674601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:02.767575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:02.830604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a22142-cc3d-480a-9bfe-8bb585bbbd76 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:02.881923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:02.882618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:02.882896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:02.883236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:02.884531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=2e2c242e3ab84c30bf5ea5e98a5032bc) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:02.884839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:02.886321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa728-8f5c-45b4-84fb-9da4abea774e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:02.896560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 147/294] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:02 2022] GET /identity/v3/role_assignments?user.id=2e2c242e3ab84c30bf5ea5e98a5032bc&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:03.758677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4b85-41eb-4e25-83bf-d8dc7a9bf840 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:03.759786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4b85-41eb-4e25-83bf-d8dc7a9bf840 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:03.760269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4b85-41eb-4e25-83bf-d8dc7a9bf840 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:03.762265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 148/295] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:03.767504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e5f8a-19bc-4da3-a190-2b17c18541b9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:03.767820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e5f8a-19bc-4da3-a190-2b17c18541b9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:03.768092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e5f8a-19bc-4da3-a190-2b17c18541b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:03.771276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9037-d58a-49e0-9fe7-3c18957f7751 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:03.771731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9037-d58a-49e0-9fe7-3c18957f7751 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:03.771918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b9037-d58a-49e0-9fe7-3c18957f7751 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:03.773418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 148/296] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:03.779062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131ab-ddc5-4e35-ae63-a88cf2de0163 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:03.779617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131ab-ddc5-4e35-ae63-a88cf2de0163 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:03.780083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e131ab-ddc5-4e35-ae63-a88cf2de0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:03.788686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6b6e5f8a-19bc-4da3-a190-2b17c18541b9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:03.790463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6b6e5f8a-19bc-4da3-a190-2b17c18541b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:03.799260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-53e131ab-ddc5-4e35-ae63-a88cf2de0163 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:03.800721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-53e131ab-ddc5-4e35-ae63-a88cf2de0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:03.877916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 149/297] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:03.884676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:04.003959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d333f-105c-4597-8161-35859d8b7258 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.004467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d333f-105c-4597-8161-35859d8b7258 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.004902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d333f-105c-4597-8161-35859d8b7258 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.006643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 150/299] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:04.012894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983756-954c-458d-b76e-3640160306e4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.013339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983756-954c-458d-b76e-3640160306e4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.013746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983756-954c-458d-b76e-3640160306e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.032700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-04983756-954c-458d-b76e-3640160306e4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:04.035470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adbc5f-9f56-4359-ab16-0a87a02fb266 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.035915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adbc5f-9f56-4359-ab16-0a87a02fb266 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.036321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adbc5f-9f56-4359-ab16-0a87a02fb266 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.037756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 151/300] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:04.038118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-04983756-954c-458d-b76e-3640160306e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:04.042687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.043140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.043569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.061710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:04.063089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:04.090370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.119567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 150/301] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:04.144454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 152/302] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:04.162815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04983756-954c-458d-b76e-3640160306e4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.168201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.211893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.276144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04983756-954c-458d-b76e-3640160306e4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.290776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf944-e79a-4094-9d48-d870ea53bc9e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.313085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.313709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.313987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.314256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.325141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:04.330396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:04.331324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:04.336378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 151/303] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:04.338579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.343230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.344461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.344461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.344461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.354966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:04.359790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:04.360699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:04.361485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:04.365797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:04.366625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.398708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.458590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406cbae-3b11-4c0a-a5be-74ca9d7022eb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.463288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.472203 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb0ab-87a1-4b92-8bea-eefaa1ee8c72 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.491626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.492182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.492461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.493259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.493918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:04.494227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.495691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.503491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 152/305] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.504364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.510324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.510938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.511214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.511484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.512202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:04.512505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.513948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.522206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 154/306] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.522968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.606686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79917dce-4b63-4a34-be6d-64bdcdc72a4a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.608224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.622391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da648-6a66-44f6-9acd-d9dfe5e2670d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.640592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.641214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.641493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.641763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.642861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.644311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.645864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 153/307] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.646608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.656265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.656827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.657107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.657376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.668036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:04.673337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:04.674229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:04.675056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 155/308] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:04.675783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.693643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.756979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a53743-db3a-40ec-8967-0c5f8f791074 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.775976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32720-793c-4369-832c-496a0e7f4191 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.790467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.791159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.791436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.791737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] PATH_INFO: `/v3/users/967e687da436478b982778ebe8b3f69d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.792853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=967e687da436478b982778ebe8b3f69d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.794269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.796157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 154/309] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/users/967e687da436478b982778ebe8b3f69d => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.796889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.810077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.810706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.810977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.811243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] PATH_INFO: `/v3/users/96698c1febaf4204a16860f5ac1c6b0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.824323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] RBAC: Authorizing `identity:get_user(user_id=96698c1febaf4204a16860f5ac1c6b0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.825778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.827369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 156/310] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/users/96698c1febaf4204a16860f5ac1c6b0b => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.828151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.837695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.897527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd1f-dbdd-4fde-b2c3-cba7a7eff6f4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.902377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:04.930935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.931464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.931780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.932049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] PATH_INFO: `/v3/groups` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.932658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.933362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828682c6-b10c-40d3-ba71-f2a956ae7b32 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:04.934071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.949114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 155/311] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Aug 17 08:25:04 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:04.950025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:04.972526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:04.973231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:04.973521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:04.973776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:04.974465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:04.974767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:04.976419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:04.991689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 157/312] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:04.991689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:05.062756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:05.069509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c34bdd-92bf-4bfb-b4ba-453f5edbcff6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.104728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb537-2977-4959-a691-1e135006b95d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.109541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.110156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.110432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.110700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.142845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.143453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.143765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.144059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.144778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, user.id=96698c1febaf4204a16860f5ac1c6b0b, scope.system=all) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:05.145086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.146510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.148129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:05.159567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 158/313] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/role_assignments?user.id=96698c1febaf4204a16860f5ac1c6b0b&scope.system=all&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:05.159567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:05.193485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.194874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.293067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65611d-ffe8-454c-96da-23bb79074173 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.310197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:05.319020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 156/314] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:05.319965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:05.335223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.336146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.337281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.337696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] PATH_INFO: `/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.338990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] RBAC: Authorizing `identity:get_user(user_id=5fd74518c2bd4ab79d789fd3f8407d1f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.340637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.342453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 159/315] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:05 2022] GET /identity/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:05.348216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:05.431115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:05.437224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51304984-add4-458a-8386-7fa4325e1034 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.471813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4d281-de30-4d36-babd-a8e182ad7293 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.482523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.483326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.484161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.484533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.486067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.488130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.490015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 157/316] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:05 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:05.501366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:05.517460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.518397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.518675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.518948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] PATH_INFO: `/v3/system/users/5fd74518c2bd4ab79d789fd3f8407d1f/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.520880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fd74518c2bd4ab79d789fd3f8407d1f, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.522264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53acd3-f9c0-4cd5-9d00-608ad15e56df None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.536387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 160/317] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Aug 17 08:25:05 2022] PUT /identity/v3/system/users/5fd74518c2bd4ab79d789fd3f8407d1f/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:25:05.580955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:05.622879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15807953-3bf2-426e-9e2f-1b5d2ad196b1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:05.662048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:05.662666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:05.662947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:05.663218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:05.663990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, user.id=967e687da436478b982778ebe8b3f69d) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:05.664299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:05.665801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eb1ab-3883-47ae-9369-b4d52f4321fd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:05.672852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 158/318] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:05 2022] GET /identity/v3/role_assignments?user.id=967e687da436478b982778ebe8b3f69d&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:06.891893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cdd8c-6bdd-4256-b7dd-fe3db4e99c26 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:06.892383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cdd8c-6bdd-4256-b7dd-fe3db4e99c26 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:06.892459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cdd8c-6bdd-4256-b7dd-fe3db4e99c26 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:06.893748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 161/319] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:06.899526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fd42-8ce7-4147-96ca-f4feadbc8e3c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:06.899913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fd42-8ce7-4147-96ca-f4feadbc8e3c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:06.900087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47fd42-8ce7-4147-96ca-f4feadbc8e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:06.917777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0d47fd42-8ce7-4147-96ca-f4feadbc8e3c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:06.919248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0d47fd42-8ce7-4147-96ca-f4feadbc8e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:06.991579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 159/320] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:07.105693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff29-e565-4694-9c8e-e624da988abe None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.106230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff29-e565-4694-9c8e-e624da988abe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.106504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff29-e565-4694-9c8e-e624da988abe None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.107884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 162/321] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:07.113271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.113563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.113839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.132259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:07.133948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:07.192749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:07.205703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 160/322] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:07.256030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ff29-e565-4694-9c8e-e624da988abe None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.357469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ff29-e565-4694-9c8e-e624da988abe None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:07.386235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:07.393210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:07.393835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.394108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.394380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.395990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:07.397822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207758b-8ea3-46db-b906-cbd4ebd978a9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:07.399585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 163/323] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:07.404842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.464475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660e1f2-08b2-4198-b72d-997320f5b596 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.464761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660e1f2-08b2-4198-b72d-997320f5b596 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.464954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660e1f2-08b2-4198-b72d-997320f5b596 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.466291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 164/324] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:07.471194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.471478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.471772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.489201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:07.490380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:07.503503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524e9ac-934c-4f31-a7f1-67cfb5e7000d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:07.538088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:07.538681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.538956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.539231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] PATH_INFO: `/v3/groups` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.539906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:07.541313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:07.554943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 161/325] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Aug 17 08:25:07 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:07.559577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 165/326] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:07.560631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.619151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:07.675181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f109263-a0f2-4434-b0d1-3d7510bbd597 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:07.713412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:07.714057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.714338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.714658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.725269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:07.731084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:07.732058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:07.732863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 162/327] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:07.738057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.833776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.851165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45b33-3b10-40e0-a7b1-737e06e77880 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:07.883810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:07.893922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:07.894550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:07.894838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:07.895114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:07.895831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:07.896137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:07.897542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:07.910867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 166/328] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:07.912166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:07.963176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b812f2-3fc8-4114-8300-c8b3ea497c52 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:07.977708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:08.015692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.017026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.017647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.018161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.035766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:08.041367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65925e-da63-462d-9eec-aafbd314953f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:08.041662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:08.042540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:08.043360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:08.044581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 163/329] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:08.052640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:08.094367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.095862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.097280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.097916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] PATH_INFO: `/v3/users/96698c1febaf4204a16860f5ac1c6b0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.100433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] RBAC: Authorizing `identity:get_user(user_id=96698c1febaf4204a16860f5ac1c6b0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:08.103511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:08.108663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 167/330] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:07 2022] GET /identity/v3/users/96698c1febaf4204a16860f5ac1c6b0b => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:08.113189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:08.195271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8d66c-ce04-4a23-8fa0-fc66114b5742 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:08.200934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:08.243389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.244189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.244472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.244744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.245814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:08.246119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:08.247848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:08.252418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da81bac-1309-4d5e-b0b7-5f489caf33de None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:08.258623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 164/331] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:08.264128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:08.308453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.309431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.309759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.310284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] PATH_INFO: `/v3/system/users/96698c1febaf4204a16860f5ac1c6b0b/roles/261207a96b1d4ffe94bbaf70881114f1` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.311362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:08.313280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=96698c1febaf4204a16860f5ac1c6b0b, role_id=261207a96b1d4ffe94bbaf70881114f1)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:08.314861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:08.325943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 168/332] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Aug 17 08:25:08 2022] PUT /identity/v3/system/users/96698c1febaf4204a16860f5ac1c6b0b/roles/261207a96b1d4ffe94bbaf70881114f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:25:08.397863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710291a-d503-4d12-a9c2-9e33348385a7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:08.437118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.437766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.438038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.438373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] PATH_INFO: `/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.439598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] RBAC: Authorizing `identity:get_user(user_id=5fd74518c2bd4ab79d789fd3f8407d1f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:08.441100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468ff45-264d-440e-bca7-041552abfd77 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:08.443161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 165/333] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:08 2022] GET /identity/v3/users/5fd74518c2bd4ab79d789fd3f8407d1f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:08.450008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:08.582329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb05df-345c-4723-8995-856083b02b01 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:08.627897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:08.643023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:08.643672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:08.643956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:08.644230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:08.644974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] RBAC: Adding query filter params (role.id=218b2ff052cd47ffb87e3861eba25516, user.id=5fd74518c2bd4ab79d789fd3f8407d1f, scope.system=all) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:08.645284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:08.648902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb252c3-4cc1-4393-af5a-91c37e0abd91 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:08.662902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 169/334] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 17 08:25:08 2022] GET /identity/v3/role_assignments?user.id=5fd74518c2bd4ab79d789fd3f8407d1f&scope.system=all&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:09.820352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e48b3-fa33-41cc-aae6-46e4d94bdee6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:09.821403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e48b3-fa33-41cc-aae6-46e4d94bdee6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:09.821508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e48b3-fa33-41cc-aae6-46e4d94bdee6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:09.823032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 166/335] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:09.829711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:09.830138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:09.830330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:09.856579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:09.857847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:09.939215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 170/336] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:10.265577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e48b3-fa33-41cc-aae6-46e4d94bdee6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:10.370246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:10.375084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e48b3-fa33-41cc-aae6-46e4d94bdee6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:10.417039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:10.417671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.417947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.418213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.435571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:10.440806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:10.441723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:10.442519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:10.444751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 167/337] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:10.451776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:10.592161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318565d-e480-44c3-856e-65cd4ae490af None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:10.615887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:10.646212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:10.646835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.647119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.647394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.648097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:10.648405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:10.649929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c5a9-1f40-464c-b545-c86aafb21972 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:10.662754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 171/338] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:10.669202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:10.674083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a14-1d57-4cd7-86b1-c45543709648 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.674579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a14-1d57-4cd7-86b1-c45543709648 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.675043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a14-1d57-4cd7-86b1-c45543709648 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.676916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 172/339] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:10.682903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2d05-683f-4835-b628-dc3923c8c764 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.683453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2d05-683f-4835-b628-dc3923c8c764 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.683995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2d05-683f-4835-b628-dc3923c8c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.703950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2eee2d05-683f-4835-b628-dc3923c8c764 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:10.705471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2eee2d05-683f-4835-b628-dc3923c8c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:10.799478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 173/340] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:10.876119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874442-049b-4f9d-adce-34bd5f6580c6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:10.902679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7240-78f2-4693-be7b-7abf07142167 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.903648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7240-78f2-4693-be7b-7abf07142167 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.904119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd7240-78f2-4693-be7b-7abf07142167 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.906216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 174/341] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:10.917731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325968f0-a432-4d75-b8df-963827ad8cea None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.918397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325968f0-a432-4d75-b8df-963827ad8cea None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.918867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325968f0-a432-4d75-b8df-963827ad8cea None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.920418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 175/342] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:10.923598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:10.923598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.923598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.923598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.925586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8456a-7cbd-4b10-9bb1-e68ad10bf51c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:10.926199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8456a-7cbd-4b10-9bb1-e68ad10bf51c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:10.926678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8456a-7cbd-4b10-9bb1-e68ad10bf51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:10.955777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-28f8456a-7cbd-4b10-9bb1-e68ad10bf51c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:10.956837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:10.958217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-28f8456a-7cbd-4b10-9bb1-e68ad10bf51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:11.029023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:11.030968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:11.096824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 176/343] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:11.103318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.103902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.104422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.135601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:11.137237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:11.192415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.226021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 168/344] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:11.236561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.260008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 177/345] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:11.260667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.386996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.462513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ab4fe-4d94-4872-bd97-c9486c09053b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:11.473814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c7b9e-2b9c-4c4d-8fdb-ae83791e519d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:11.504569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:11.505554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.506055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.506516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.507888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:11.510107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:11.512184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 169/346] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:11.513241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.588895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:11.589445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.589721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.589986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.622598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:11.624127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66e3f-f7ad-4a1c-a1a1-005fa83227ff None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:11.627892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:11.628977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:11.629988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:11.636832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 178/347] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:11.637878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.663692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.667632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:11.668372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.668895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.669103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.680766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:11.686609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:11.687805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 08:25:11.688935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:11.690546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 170/348] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:11.691444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.697989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.776083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9eb43-c345-4caf-903b-5005f41dada7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:11.815846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:11.816689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.817037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.817429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.817789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885e31-9b6f-4204-8adf-d16d9358cac6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:11.824761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:11.826302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:11.829741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 179/349] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:11.830591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.869186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:11.870706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:11.871165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:11.871889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:11.872734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:11.873213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:11.875807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:11.892904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 171/350] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:11.893672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:11.945783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.957781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:11.964431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a05-3192-4ecf-8e53-8c68e5e90275 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.005015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.005654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.005939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.006206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.018109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:12.023178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:12.024145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:12.024947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:12.025548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e187424-f945-40e8-a6b0-c81f638dbd39 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.025619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 180/351] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:12.025619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.076314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.077693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.078115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.079509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.080876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:12.081780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.083696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.094930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 172/352] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:12.096193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.161994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05467f-4a23-4814-97eb-4275a00504e5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.206932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.207635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.207906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.208235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.208924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:12.209233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.210682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ef9be-4999-4f47-af68-b688da97a59b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.218339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 181/353] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:12.219666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719631-abeb-4e84-ac99-b5e83334f455 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.219948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719631-abeb-4e84-ac99-b5e83334f455 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.220217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af719631-abeb-4e84-ac99-b5e83334f455 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.221684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 182/354] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:12.222348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af719631-abeb-4e84-ac99-b5e83334f455 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.227599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f0c0f-d9f7-474e-8381-a897db51818b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.243957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.250350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.284300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.285600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.286152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.286621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.362044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af719631-abeb-4e84-ac99-b5e83334f455 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.385123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.387062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c57c3c-baaf-41d1-bc1d-7b2c4102e6e8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.412152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.413307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.413777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.414353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.416108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:12.416862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.418914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.431066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 183/355] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:12.432267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.509328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 173/356] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:12.511750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75e99-d888-445b-a114-8f7016b1707c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.512058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75e99-d888-445b-a114-8f7016b1707c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.512316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa75e99-d888-445b-a114-8f7016b1707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.519423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.535586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3aa75e99-d888-445b-a114-8f7016b1707c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:12.536794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3aa75e99-d888-445b-a114-8f7016b1707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:12.545688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.561792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a13e-2e34-4945-b1e7-6e9cbf942cf9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.619967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.620820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.621242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.621723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] PATH_INFO: `/v3/users/96698c1febaf4204a16860f5ac1c6b0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.623128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] RBAC: Authorizing `identity:get_user(user_id=96698c1febaf4204a16860f5ac1c6b0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.624866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.626622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 184/358] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/users/96698c1febaf4204a16860f5ac1c6b0b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:12.627316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.627654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 174/358] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:12.629008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9f5ef-18af-43c0-bb0b-48ae8397af7d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.629294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9f5ef-18af-43c0-bb0b-48ae8397af7d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.629570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9f5ef-18af-43c0-bb0b-48ae8397af7d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.630985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 175/359] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:12.631527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9f5ef-18af-43c0-bb0b-48ae8397af7d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:12.759947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05345af-5b04-43a6-b962-84f1405c8425 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.784811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9f5ef-18af-43c0-bb0b-48ae8397af7d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:12.798765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.799499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.799834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.800159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.812566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.833357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:12.833996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.834507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.834793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.836335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.838919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f80d-9939-4ead-8ea4-1456ad9ea86d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.841743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 176/360] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:12.845025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:12.845364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:12.845643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:12.864358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:12.865561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:12.888622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:12.891209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:12.893343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:12.944885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 177/361] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:12.946353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.025918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 185/362] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:13.026663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.062839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f81e59-d00f-41b3-8178-f79d935f3854 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.081028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.105895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.106507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.106844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.107217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.108090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] RBAC: Adding query filter params (role.id=261207a96b1d4ffe94bbaf70881114f1, user.id=96698c1febaf4204a16860f5ac1c6b0b, scope.system=all) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:13.108400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.109874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.116806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.125437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 178/363] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 17 08:25:12 2022] GET /identity/v3/role_assignments?user.id=96698c1febaf4204a16860f5ac1c6b0b&scope.system=all&role.id=261207a96b1d4ffe94bbaf70881114f1 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.126217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.174841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad489-494e-4f40-99c9-613c9e0e011a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.252173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.252845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.253126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.253401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.255326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.256854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.259571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 186/364] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.263052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.315796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1ccd-75c9-40ef-bbbd-3a9c087baee7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.365666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.366652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.367160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.367436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.385926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:13.391419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:13.392424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:13.393235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:13.393856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 179/365] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:13.394401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.413778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f7da-a16a-4578-8b37-312f1a61ebed None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.425020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.461087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.462005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.462281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.462550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.463714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.465140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.466948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 187/366] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.467509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.476359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.526821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532e20-dbb4-41da-880e-0aebe6c30e1e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.567921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.568548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.568813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.569082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.569925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:13.570234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.572859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.580650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 180/367] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=599414de16304217a39bf1ab5b7d8724 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.581807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.614745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f0dd-a55d-45a5-9347-0483aad26eb8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.666467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.667081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.667438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.668547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.683315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:13.690842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:13.691865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:13.692683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:13.693341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 188/368] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:13.694479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.729234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17f5d-db27-49dd-b36d-088a8dca380c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.738516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.762575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:13.780243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.781118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.782298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.782579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.783258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:13.784586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.785981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.798156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 181/369] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.799577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.823138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95315ef-68a3-4f21-8440-b4a4577fe72f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.869250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.870184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.870467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.870739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.871898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.873818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.876139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 189/370] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.876913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.936492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dc15-c054-4964-86d7-146e07801625 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:13.972447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:13.973093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:13.973326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:13.973596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:13.974263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:13.974562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:13.975971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:13.985637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 182/371] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:13.986519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:13.998897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec02-ce26-41c5-bb80-d27be05c7f04 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.001529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.037517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.042678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.043303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.043607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.043886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.098962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f20a4-f5df-4284-95b4-c88b142f7173 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.125486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.127166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.134701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.135305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.135914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.135914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.136584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:14.136890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.138302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.144903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 183/372] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:14.145706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.256160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce6806-f7b5-4046-bc34-853f58909ef6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.270881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.292649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 190/373] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:14.293635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.294264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.294543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.294819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.298943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.309839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.369626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.371010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9c8f-5eeb-4f72-8a05-8f2895228f62 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.465551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b848fa-fd12-4ec9-9b9c-053974681d95 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.495220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 184/374] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:14.496552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd127cd-7c92-4570-8620-011e97466700 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.496831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd127cd-7c92-4570-8620-011e97466700 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.497102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd127cd-7c92-4570-8620-011e97466700 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.498347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 185/375] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:14.506359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.506628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.506903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.518044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.518735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.519015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.519286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.520454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.521887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.523937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 191/376] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:14.525191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.527926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:14.529104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:14.532957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.617452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 186/377] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:14.618468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.621836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.674387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc1b17-8c46-4684-bee4-a375a207ff0d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.723847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.724499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.724775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.725039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] PATH_INFO: `/v3/projects/0453a8b2bb634303b77e24e668baded5` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.726325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] RBAC: Authorizing `identity:get_project(project_id=0453a8b2bb634303b77e24e668baded5)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.727943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.729743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 192/378] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/projects/0453a8b2bb634303b77e24e668baded5 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:14.735298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.737883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffc537-7dd1-4487-a0d6-28eb30e2eec1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.774911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.775573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.775857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.776129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.777253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.778760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:14.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 187/379] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:14.786107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:14.797925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:14.923625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e7ca-b5dc-42f3-aa8c-7dcac1103e2e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.923931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72c50e-6231-495b-a95c-b63a9e44eb54 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:14.995730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:14.996648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:14.996648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:14.996936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:14.997676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:14.997986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:14.999403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:15.009688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 188/380] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=599414de16304217a39bf1ab5b7d8724 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:15.053106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:15.053774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:15.054871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:15.054871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] PATH_INFO: `/v3/groups/4e7c730b684a43e99f86184886efa52c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:15.072398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] RBAC: Authorizing `identity:get_group(group_id=4e7c730b684a43e99f86184886efa52c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:15.073931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:15.076100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 193/381] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:14 2022] GET /identity/v3/groups/4e7c730b684a43e99f86184886efa52c => generated 229 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:15.084691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:15.209366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:15.219004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:15.243889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:15.304867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b7d57-ca6a-468f-b1b8-85b228a95fce None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:15.390179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:15.391711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:15.391711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:15.391711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:15.392058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] RBAC: Adding query filter params (group.id=4e7c730b684a43e99f86184886efa52c, role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=0453a8b2bb634303b77e24e668baded5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:15.394357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:15.394357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:15.406780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 189/382] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:15 2022] GET /identity/v3/role_assignments?group.id=4e7c730b684a43e99f86184886efa52c&scope.project.id=0453a8b2bb634303b77e24e668baded5&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:15.425428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab890d-c3b9-4a8f-b4fa-821d3da6909f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:15.510030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:15.510670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:15.510946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:15.511217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:15.530400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:15.541023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:15.541982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:15.542816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:15.552880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 194/383] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:15.554803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:15.716942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa21c-61a9-4508-997c-1dc7c668ced8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:15.759366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:15.759948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:15.760309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:15.760536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:15.761198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:15.761494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:15.762844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:15.767741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:15.775841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 190/384] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:15.781521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:15.856709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:15.903654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3a72b-fc7b-4e96-83cb-6978f42b81b5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:15.945143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:15.946361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:15.946640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:15.946909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:15.948099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:15.949551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a8177-a0bf-448c-b19f-6b233c043f9f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:15.951475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 195/385] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:15 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:15.957374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:16.013349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2b9-528a-464c-8a29-eab7013a535c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.013586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2b9-528a-464c-8a29-eab7013a535c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.013817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccd2b9-528a-464c-8a29-eab7013a535c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.015367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 196/386] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:16.020268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.020549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.020823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.040436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:16.041734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:16.074487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf641c1-32c4-47fb-8285-ccc2e94c0796 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:16.115895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:16.116535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.116814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.117087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.118255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:16.119731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:16.121720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 191/387] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:15 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:16.128319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:16.132546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 197/388] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:16.197995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:16.235308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de7b5-c17a-4bad-97d9-8c1de8dd9599 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:16.273634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:16.274249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.274527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.274798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.277780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, group_id=bd0a36eab0b945fbafb7f8226b6ae876, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:16.279222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d85-08bd-4de3-86a4-875d82dee7bb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:16.298175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 192/389] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 17 08:25:16 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:25:16.595982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:16.675513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:16.724592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895b264-8c68-4d20-85ae-acd3ca00e2a4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:16.745412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2082d-a3b0-4ab2-a5c1-f6cfd82eb3c8 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.746047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2082d-a3b0-4ab2-a5c1-f6cfd82eb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.746508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2082d-a3b0-4ab2-a5c1-f6cfd82eb3c8 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.748323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 193/390] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:16.753721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.754252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.754731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.762035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:16.762854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.763143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.763417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.776969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:16.778447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:16.779920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:16.792760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:16.793747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:16.794547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 198/391] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:16.803658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:16.931523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 194/392] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:16.942422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed121c25-9032-4997-834f-23152dd8b1ef None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:16.971919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:16.988547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:16.989228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:16.989508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:16.989781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:16.990454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:16.990760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:16.992156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:17.003385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 199/393] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:17.008680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.087454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:17.146377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397b8a-7fa4-487c-b3ab-54c35a07ae7e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:17.192345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:17.192912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.193192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.193464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.194640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:17.196671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:17.198254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 195/394] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:17 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:17.204270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.340293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5a1-dda6-4584-abb8-54ce60e9060c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:17.377936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:17.379065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.379567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.380040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.381423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:17.383151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:17.385392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 200/395] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:17 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:17.387214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.391703 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.457988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:17.537061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ad6e4-2617-4851-9f2f-4a267416f05d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:17.577211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed1c2-87d2-44f6-856b-fa736ded4c0d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:17.595322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:17.596289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.596761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.597174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.599598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=03a27fa15ff849778d6aa0614f5bcdd6, group_id=bd0a36eab0b945fbafb7f8226b6ae876, role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:17.601191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:17.615448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:17.626724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 201/396] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 17 08:25:17 2022] PUT /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/599414de16304217a39bf1ab5b7d8724 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:17.634929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:17.636052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.636507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.636953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.649954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-821099ae-4a1b-42ff-b139-7362f55f0c77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:17.655255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:17.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:17.657396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:17.659899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 196/397] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:17.666485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.782241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc64db-688c-4179-ad1c-5959e213bab6 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:17.796728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:17.825152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:17.825779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.826060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.826334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.827011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:17.827311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:17.828730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:17.834030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc865-e7fb-4f70-a9fc-65fff6d7d599 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.834616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc865-e7fb-4f70-a9fc-65fff6d7d599 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.835089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc865-e7fb-4f70-a9fc-65fff6d7d599 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.837650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 197/398] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:17.843346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 202/399] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:17.843988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3851-74fe-4fed-b702-919879e04730 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:17.844468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3851-74fe-4fed-b702-919879e04730 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:17.844931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3851-74fe-4fed-b702-919879e04730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:17.855221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:17.883579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-871e3851-74fe-4fed-b702-919879e04730 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:17.883579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-871e3851-74fe-4fed-b702-919879e04730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:17.960419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 198/400] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:17.976329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399949a7-1b1c-4111-bd16-13a23f4e88e7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.011398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.012064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.012339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.012610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.013739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:18.015282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4db8-aed0-480e-8ef0-192af79628f4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:18.017220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 203/401] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:17 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:18.022674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3851-74fe-4fed-b702-919879e04730 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.065232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6aeb-b667-4680-9e2e-0379a1839a06 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.065535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6aeb-b667-4680-9e2e-0379a1839a06 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.065713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6aeb-b667-4680-9e2e-0379a1839a06 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.067372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 204/402] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:18.080625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.080905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.081341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.112598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:18.113795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:18.153086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3851-74fe-4fed-b702-919879e04730 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.175219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.184721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.215854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.216492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.216769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.217038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.219174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:18.220634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:18.222417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 199/403] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:18.229891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.248095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 205/404] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:18.297812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.337486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac052b-e5f5-4b81-9420-0afb36ced757 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.407817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad137-149f-40fb-a05e-0c4e980ab623 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.423345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.424042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.424376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.424646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.426665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, group_id=bd0a36eab0b945fbafb7f8226b6ae876, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:18.428126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:18.444816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.446615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.447150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.447438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.461247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:18.467638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:18.468536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:18.469341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:18.469958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 206/405] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:18.475275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.480871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 200/406] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 17 08:25:18 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:18.531976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.623156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.642830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcc5a3-20ff-4128-a298-59d6fa80ce72 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.693364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.693972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.694250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.694525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.695192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:18.695496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:18.696939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:18.702584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.706009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:18.712238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.769802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235d73c-3df9-4783-884b-4b6e6e94cb8e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.807730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.808370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.808646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.809156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.814005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.820522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85c606-6ad7-48a0-9891-5595dd80d693 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.823598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:18.832410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:18.834209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:18.835891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:18.845104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 201/408] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:18.846700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.858882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.859798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.860217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.860629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.861894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:18.863533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:18.865586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 208/409] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:18.871048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:18.958220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b4255-c395-4605-979e-26431dbe6316 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.960185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:18.976007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581185a2-a73e-4b32-b599-2c6371a09685 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:18.995525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:18.996602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:18.997084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:18.997555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:18.998447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:18.998970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.000697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8b661-bd95-4b2f-9313-9488fd71fc86 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.015857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.015857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.015857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.016191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.016520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 202/410] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:19.017138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.018366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eee1a-3291-41e5-a09d-1d63c2aed6ea None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.018605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.019079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eee1a-3291-41e5-a09d-1d63c2aed6ea None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.019563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eee1a-3291-41e5-a09d-1d63c2aed6ea None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.020643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 209/411] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:18 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:19.021756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 203/412] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:19.026403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:19.026790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eee1a-3291-41e5-a09d-1d63c2aed6ea None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:19.065533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:19.152016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eee1a-3291-41e5-a09d-1d63c2aed6ea None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:19.168109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf7179-2e33-4d89-949d-14dd9abb5d25 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:19.196926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.197850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.198133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.198406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.201903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83, group_id=bd0a36eab0b945fbafb7f8226b6ae876, role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.203343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.208568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.209447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.209824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.210282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] PATH_INFO: `/v3/groups/4e7c730b684a43e99f86184886efa52c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.211826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7c730b684a43e99f86184886efa52c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.213273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ede01-ce91-487a-b345-694a8aae8345 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.215462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 210/413] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:19 2022] GET /identity/v3/groups/4e7c730b684a43e99f86184886efa52c => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:19.216775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.217129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.217473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.220190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 204/414] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 17 08:25:19 2022] PUT /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83/groups/bd0a36eab0b945fbafb7f8226b6ae876/roles/599414de16304217a39bf1ab5b7d8724 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:19.221396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:19.251207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:19.254310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:19.255894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:19.343694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f786-88e2-4e50-9113-cecace803fad None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:19.345855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 211/415] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:19.392720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.393357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.393636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.393919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] PATH_INFO: `/v3/projects/0453a8b2bb634303b77e24e668baded5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.395050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] RBAC: Authorizing `identity:get_project(project_id=0453a8b2bb634303b77e24e668baded5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.396522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.398287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 205/416] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:19 2022] GET /identity/v3/projects/0453a8b2bb634303b77e24e668baded5 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:19.404368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:19.435959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:19.521680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782868-dfe5-4c8e-ab7c-320150339e42 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:19.562355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.563397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.563935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.564502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] PATH_INFO: `/v3/projects/0453a8b2bb634303b77e24e668baded5/groups/4e7c730b684a43e99f86184886efa52c/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.570639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] RBAC: Authorizing `identity:create_grant(project_id=0453a8b2bb634303b77e24e668baded5, group_id=4e7c730b684a43e99f86184886efa52c, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:19.572975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:19.601741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 212/417] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 17 08:25:19 2022] PUT /identity/v3/projects/0453a8b2bb634303b77e24e668baded5/groups/4e7c730b684a43e99f86184886efa52c/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:19.766550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:19.865527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:19.875330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cd840-44c3-4ffe-b2a2-f21b83f8072b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:19.915101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:19.915789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:19.916069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:19.916343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:19.927892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0c385dd7-8d75-48e2-b5a7-c4593cd7df73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:19.934903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:19.935907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:19.936839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:19.939645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 206/418] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:19.942259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.049002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e2b8-22a1-46a3-877e-bd0ae6dd2c7c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.049180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e2b8-22a1-46a3-877e-bd0ae6dd2c7c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.049452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e2b8-22a1-46a3-877e-bd0ae6dd2c7c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.050081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:20.050988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 207/419] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:20.056210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.056486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.056761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.071482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de16b-23d2-4bfb-88fa-506537e43eea None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.074935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:20.076158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:20.122051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:20.122705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.122980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.123243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.124001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] RBAC: Adding query filter params (name=member) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:20.124303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:20.125679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:20.143387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 213/420] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:20.144644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.210724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 208/421] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:20.278371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883912-77ea-440a-bea2-2689573b7018 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.322191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:20.322773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.323050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.323318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.349296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:20.410617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:20.412089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:20.514957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.525098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 214/422] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 08:25:20.530900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.619057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:20.630351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057703d-b605-4b6d-9e8f-4b4c87101dfd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.647922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:20.684790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:20.685701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.687204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.687873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.711560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:20.716969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:20.718065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:20.719070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:20.730394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 209/423] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:20.735571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.765279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8899f-ace5-4684-ba29-6b4dd6b3021f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.843625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:20.844266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.844542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.844812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.847202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:20.848667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:20.857098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 215/424] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:20.858436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.892898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6436c5-57b5-4118-bd83-fc2569d5a01f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.938661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:20.939267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.939609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.939986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.940650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:20.940951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:20.942424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458d67a-3068-478f-a0c0-5e829d484bfe None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:20.957046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 210/425] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:20.958330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620bc3-d1ba-4bc7-900c-8f19b4755261 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:20.958713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620bc3-d1ba-4bc7-900c-8f19b4755261 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:20.958991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620bc3-d1ba-4bc7-900c-8f19b4755261 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:20.960308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 211/426] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:20.961304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620bc3-d1ba-4bc7-900c-8f19b4755261 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:20.966506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:20.971917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58222-db2b-47fb-9494-060ffa8c4c2d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:20.996719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.019521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.020880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.021555 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.021977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.024063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.025700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336e7e7-ccdf-4a29-94e7-b1c2f4712adf None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.033291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 216/427] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.033291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.033291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.033571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.052756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:21.054419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:21.101725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620bc3-d1ba-4bc7-900c-8f19b4755261 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.132608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 217/428] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:21.133494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.149828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.151004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.151473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.151951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.226464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.229220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.233071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.255580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c811c6-31b6-4ac3-b428-f99366e0efef None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.280070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.298777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.299384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.299685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.299955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.300681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:21.300985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.302408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.318501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 218/429] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.402064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 212/430] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:21.407784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.475694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.540510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f113-f2e5-4f3e-9450-711b257205af None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.577504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102015d-a764-4366-a52f-5270e585357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.578245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102015d-a764-4366-a52f-5270e585357e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.578523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102015d-a764-4366-a52f-5270e585357e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.578792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102015d-a764-4366-a52f-5270e585357e None admin] PATH_INFO: `/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.581170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102015d-a764-4366-a52f-5270e585357e None admin] RBAC: Authorizing `identity:get_project(project_id=03a27fa15ff849778d6aa0614f5bcdd6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.582605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102015d-a764-4366-a52f-5270e585357e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.584758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 219/431] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/projects/03a27fa15ff849778d6aa0614f5bcdd6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.590540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102015d-a764-4366-a52f-5270e585357e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.600772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531eeee-2126-4980-b9ab-f2bd6c5cd28e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.604155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.662152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.662403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.663074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.663345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.663667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.681635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:21.687852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:21.688756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 08:25:21.689558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:21.690824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 213/432] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:21.694987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.738878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102015d-a764-4366-a52f-5270e585357e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.777617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.778253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.778530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.778800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.784129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.784129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d5988-06f2-40dd-8577-bb3ecd521cc5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.784129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 220/433] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.784485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa61a-c7ef-43e0-9fd7-2543d5ce844c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.785884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa61a-c7ef-43e0-9fd7-2543d5ce844c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.785884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa61a-c7ef-43e0-9fd7-2543d5ce844c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.789142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 221/434] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:21.790533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fa61a-c7ef-43e0-9fd7-2543d5ce844c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:21.819236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f32d-2910-4509-99f2-b48dd8fb5a5a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.869183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.869859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.870136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.870404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.871058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:21.871606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.875690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0901-5810-4eed-84a1-8fffab4c6f58 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.884436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 214/435] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.884436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.884436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.884436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.901864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:21.903044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:21.927304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.928375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fa61a-c7ef-43e0-9fd7-2543d5ce844c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:21.949942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:21.975175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:21.975845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:21.976125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:21.976397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:21.977157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:21.977489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:21.978885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce67220-e52e-4cf8-913d-9f2ead8d40b5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:21.984484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 215/436] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:21.985383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 222/437] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=03a27fa15ff849778d6aa0614f5bcdd6&role.id=599414de16304217a39bf1ab5b7d8724 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:21.985962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.107583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819729d7-bc43-418f-b93e-f6f37f7c1484 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.144209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.144819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.145098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.145370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.173471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.174820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7a51-8ac1-4bb9-87aa-a09e9379a510 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.174934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7a51-8ac1-4bb9-87aa-a09e9379a510 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.175216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7a51-8ac1-4bb9-87aa-a09e9379a510 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.176570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 223/438] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:22.183126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.183406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.183621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.206392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:22.207628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:22.219839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.221591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.288565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 224/439] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:22.292096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.336450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 216/440] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:22.341836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.413022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.425869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7df40c-8f9c-40fb-ad74-7ca9ebf1f6ff None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.441673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.458725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdd2eb-b119-4a7c-9466-97dd8dd08d50 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.467788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.468700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.469187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.469638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.481181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:22.486136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:22.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:22.488253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:22.490159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 225/441] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:22.495526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.496180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.496460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.496573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.496743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.497840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.499281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.505454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 217/442] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:22.506077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.596798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5f762-9ea2-4bf4-86e5-360a5518ee2f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.614349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e98571-0ff9-41e1-98ad-6606d347de2d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.633794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.634390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.634665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.634926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.635681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:22.635984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.637350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.638024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.645522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 226/443] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:22.650767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.651035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.651390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.651697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.651969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.653082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.654501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.656083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 218/444] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:22.656825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.683037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.752840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060d99a-4b1f-44d5-bdef-a13ceb31a3b0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.756424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04817c-aa2c-4d04-a356-e760e02d42ad None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.785281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.785930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.786212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.786481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.788820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.789409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.790213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.790478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.797786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:22.802969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:22.803961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:22.804954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 227/445] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:22.806403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.848299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.858675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.860159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.894805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:22.903890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef139-6151-48ee-b0de-e0352e5f079f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:22.937599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:22.938195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:22.938471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:22.938800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:22.939529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=218b2ff052cd47ffb87e3861eba25516, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:22.939908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:22.941325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:22.947344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 228/446] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=218b2ff052cd47ffb87e3861eba25516 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:22.948143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:22.957745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 219/447] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:22.964290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.065556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65eec-0f07-4d35-9a14-6535bbf15f89 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.066449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.077739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28723850-e8bc-44fd-a63e-bf4a0c6a572a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.108370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.109006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.109280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.109545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.110202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:23.110500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.111894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.119130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.119789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.120067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.120336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] PATH_INFO: `/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.120569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 229/448] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:23.121488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed2d5eaa7c54cc1b91bc719dd4e3b83)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.122922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.126641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.127701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 220/449] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:22 2022] GET /identity/v3/projects/5ed2d5eaa7c54cc1b91bc719dd4e3b83 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:23.129984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.147806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.249890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610268b2-e06b-456c-b141-cb97f74b3371 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.251348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4997-9b31-4585-8d1b-69cb03336a71 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.292264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.292495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.292908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.292983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.293245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.293348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.293428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] PATH_INFO: `/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.293497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.294539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] RBAC: Authorizing `identity:get_group(group_id=bd0a36eab0b945fbafb7f8226b6ae876)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.296112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.297568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 221/450] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/groups/bd0a36eab0b945fbafb7f8226b6ae876 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:23.303336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.331572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.361861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.363310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.380300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.401469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b0428-98c6-4fc5-9fb7-d25d6225410b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.433612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.434206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.434483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.434755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.435466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] RBAC: Adding query filter params (group.id=bd0a36eab0b945fbafb7f8226b6ae876, role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:23.435873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.437276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.442814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 222/451] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/role_assignments?group.id=bd0a36eab0b945fbafb7f8226b6ae876&scope.project.id=5ed2d5eaa7c54cc1b91bc719dd4e3b83&role.id=599414de16304217a39bf1ab5b7d8724 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:23.468917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 230/452] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:23.474886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.568478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.580768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690c17-1c8b-48a0-bf41-ad4a25bb6ac4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.618433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.619069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.619346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.619653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] PATH_INFO: `/v3/projects/0453a8b2bb634303b77e24e668baded5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.620770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0453a8b2bb634303b77e24e668baded5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.622198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.623842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 223/453] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/projects/0453a8b2bb634303b77e24e668baded5 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:23.629438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.731564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bad051-d60f-45ee-8be7-516083acf955 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.749234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:23.768533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.769153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.769427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.769697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] PATH_INFO: `/v3/groups/4e7c730b684a43e99f86184886efa52c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.770883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7c730b684a43e99f86184886efa52c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.772351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b480c5-6392-42b1-a238-205c43f3c7b6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.774198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 231/454] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/groups/4e7c730b684a43e99f86184886efa52c => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:23.779852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:23.876956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794be2a-0d95-4dc2-a44a-306a8de5f6f5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:23.909209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:23.909802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:23.910089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:23.910364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:23.911077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] RBAC: Adding query filter params (group.id=4e7c730b684a43e99f86184886efa52c, role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=0453a8b2bb634303b77e24e668baded5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:23.911387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:23.912825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb3cc-0ad8-453e-9662-bf58e56d0f01 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:23.918318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 224/455] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 17 08:25:23 2022] GET /identity/v3/role_assignments?group.id=4e7c730b684a43e99f86184886efa52c&scope.project.id=0453a8b2bb634303b77e24e668baded5&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:26.162414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a97eb-3fa3-44b8-b739-62bfb2dc0152 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.163415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a97eb-3fa3-44b8-b739-62bfb2dc0152 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.163918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a97eb-3fa3-44b8-b739-62bfb2dc0152 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.166282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 232/456] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:26.171404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652bad-d91e-466d-bca6-9ffc9d33e401 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.172240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652bad-d91e-466d-bca6-9ffc9d33e401 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.172697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652bad-d91e-466d-bca6-9ffc9d33e401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.200558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2c652bad-d91e-466d-bca6-9ffc9d33e401 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:26.202076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2c652bad-d91e-466d-bca6-9ffc9d33e401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:26.229433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:26.300182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 225/457] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:26.394050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ae04-d2c6-4958-99e8-69ab69a1f09b None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.394388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ae04-d2c6-4958-99e8-69ab69a1f09b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.394673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ae04-d2c6-4958-99e8-69ab69a1f09b None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.396351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 233/458] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:26.401950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.402235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.402512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.428608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:26.429739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:26.505323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ce1a7-2b5e-438c-a8ed-0f75ec70bc01 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.505899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ce1a7-2b5e-438c-a8ed-0f75ec70bc01 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.506344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ce1a7-2b5e-438c-a8ed-0f75ec70bc01 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.507902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 234/459] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:26.520189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.520661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.521093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.521406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 226/460] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:26.556477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:26.557959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:26.641363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:26.661185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 235/461] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:26.759787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:26.782382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c4cf-d3d2-4085-8d05-082436896a75 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:26.826493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:26.827125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:26.827497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:26.827846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:26.828590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:26.838958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:26.841455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:26.862412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:26.863362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:26.864260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:26.864260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:26.864260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:26.871377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 227/462] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:26.885848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:26.981898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817eaf2-9fc4-4dbd-beb3-72da3e61ec9d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:26.999931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.020476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.021084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.021368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.021644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.033529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.035031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:27.050651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:27.051604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:27.052476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:27.052476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:27.052476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:27.052476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 236/463] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:27.058541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.084926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1b975-af35-4ee8-8f5d-a50362be9b92 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.121657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.122608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.123047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.123459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.124258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:27.124977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.126478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.129155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.141145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 228/464] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:27.142249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.170210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046172ae-2b17-4c9d-aeba-070ceaa6d4f4 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.205516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.206109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.206380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.206648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.207281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:27.207601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.208956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.226415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 237/465] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:27.228054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.254150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5306-610e-48b4-a8eb-c4bc1ab4ef77 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.258592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.291667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.292554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.293039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.293307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.303854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.305852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ac5957f0-3a4d-4242-9f56-63de3fe2d732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:27.320902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:27.321909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:27.322946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:27.322946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:27.322946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:27.329587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 229/466] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:27.330996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3d6b-3ce8-461b-b032-239f5b75fea4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.331446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3d6b-3ce8-461b-b032-239f5b75fea4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.331738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee3d6b-3ce8-461b-b032-239f5b75fea4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.333113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 230/467] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:27.333973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee3d6b-3ce8-461b-b032-239f5b75fea4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.334231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861529c-9a99-45ba-a145-c82417cd83ee None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.373540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.374254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.374597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.374942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.375752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.377185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.388058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.401192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 238/468] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:27 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:27.402132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.464749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee3d6b-3ce8-461b-b032-239f5b75fea4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.505793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.506408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.506687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.506974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.507645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.509155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c072a27-33a1-4cf8-a8cb-41e13ac2a72a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.542858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 231/469] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:27 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:27.544286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.545410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490930a9-5db8-4bc6-9232-6f6e3b466696 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.545710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490930a9-5db8-4bc6-9232-6f6e3b466696 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.546176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490930a9-5db8-4bc6-9232-6f6e3b466696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.557144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb1ff-3f6d-4213-aef4-c3a0882f7cce None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.584678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-490930a9-5db8-4bc6-9232-6f6e3b466696 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:27.586047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-490930a9-5db8-4bc6-9232-6f6e3b466696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:27.617919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.619337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.619868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.620334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.621252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:27.622508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.624551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.644151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 239/470] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:27.650379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:27.692966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 232/471] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:27.791331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e376e4-1296-4751-a8ec-a73bd59f5161 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:27.828418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:27.828949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.829226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.829828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.830474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:27.832025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569aca1d-7d53-405a-a9ea-5b2813ca5f69 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:27.850886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:27.859207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 240/472] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:27 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:27.897837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194b52-13ac-4039-94cf-4ad45d9df830 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.898183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194b52-13ac-4039-94cf-4ad45d9df830 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.898385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194b52-13ac-4039-94cf-4ad45d9df830 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.900605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 233/473] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:27.906161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:27.906445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:27.906720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:27.927140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:27.928632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:28.003163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194b52-13ac-4039-94cf-4ad45d9df830 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.015182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 241/474] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:28.052971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:28.140929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194b52-13ac-4039-94cf-4ad45d9df830 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.180049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.181222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.181497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.181765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.192622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:28.194088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:28.210487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:28.211468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:28.212387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:28.212387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:28.212387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.212387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 234/475] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:28.217843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.302958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.345550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712fb42-d7fd-4175-ad4f-c01f7e223cc1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.382129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.382737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.383018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.383854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.384514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:28.384820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:28.386205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:28.397856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 242/476] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:28.398343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:28.403873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.513507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:28.527500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da0d67-589d-4c74-90f3-1dad35dfb74d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.540173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4d51-f7a1-4326-88ef-635531a599dc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.578157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.578767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.579048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.579323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.580286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:28.581659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:28.592357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.sql.core [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 08:25:28.592357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 08:25:28.592357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [parameters: {'id': '59aca338dbca49229d865fa75861fbe7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 08:25:28.592357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Aug 17 08:25:28.611331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:25:28.612343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application yield resource Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise self.value Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application session.commit() Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 08:25:28.613276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.flush() Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application compat.raise_( Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 08:25:28.614137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:25:28.615039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:25:28.616000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [parameters: {'id': '59aca338dbca49229d865fa75861fbe7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:28.616981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 08:25:28.618397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.619254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 235/477] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 17 08:25:28 2022] POST /identity/v3/roles => generated 144 bytes in 310 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:28.623960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.623960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.623960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.623960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.624666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:28.624804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.625719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:28.676246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 243/478] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:28 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:25:28.737523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6a38-2385-49e2-b317-b2ec441839e3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.774886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.775522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.775830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.776108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.788328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5c912e2f-7511-491b-88df-dd123992455f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:28.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:28.796440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 08:25:28.798374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:28.799902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 236/479] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:25:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:28.801786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:28.868657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:28.918761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849f87-00b0-4d98-b682-be8b0ca470d1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:28.954977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:28.955495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:28.955796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:28.956063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:28.956725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:28.957021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:28.958372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c5e5-c323-4503-99d3-2dfeeba76c9a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:28.971380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 244/480] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:29.702569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ded16-5724-4ef4-a18f-2962957e897f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:29.702569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ded16-5724-4ef4-a18f-2962957e897f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:29.702569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ded16-5724-4ef4-a18f-2962957e897f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:29.703770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 237/481] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:29.709579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c8fe-ccf6-4e8a-8405-205bf9daee81 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:29.710423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c8fe-ccf6-4e8a-8405-205bf9daee81 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:29.710913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c8fe-ccf6-4e8a-8405-205bf9daee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:29.729214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b0e5c8fe-ccf6-4e8a-8405-205bf9daee81 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:29.730715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b0e5c8fe-ccf6-4e8a-8405-205bf9daee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:29.811953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 245/482] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:30.237729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ded16-5724-4ef4-a18f-2962957e897f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:30.251392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:30.305093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2dec8-b83f-414d-a844-1b0f20fe4e94 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.306261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2dec8-b83f-414d-a844-1b0f20fe4e94 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.306770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2dec8-b83f-414d-a844-1b0f20fe4e94 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.308362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 246/483] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:30.313526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd95d4-5643-427a-9498-eb8650bb5f9d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.314040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd95d4-5643-427a-9498-eb8650bb5f9d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.314513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd95d4-5643-427a-9498-eb8650bb5f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.344526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bddd95d4-5643-427a-9498-eb8650bb5f9d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:30.345718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bddd95d4-5643-427a-9498-eb8650bb5f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:30.371499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ded16-5724-4ef4-a18f-2962957e897f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:30.383841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:30.416955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:30.417583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.417873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.418117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.436403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:30.443640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 247/484] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:30.443640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa80-a193-44e7-bd44-695cc96eaa0c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.443640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa80-a193-44e7-bd44-695cc96eaa0c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.443640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa80-a193-44e7-bd44-695cc96eaa0c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.443640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 248/485] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:30.446519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.446796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.447062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:30.448868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:30.449725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:30.450527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:30.457239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 238/486] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:30.465986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:30.473671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:30.474879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:30.554013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 249/487] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:30.623893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:30.675252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e12adc-9bba-471d-9ad5-82fc26e2e473 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:30.721375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:30.722024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.722317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.722591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.723261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:30.723580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:30.724947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:30.738521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 239/488] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:30.743992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:30.788309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:30.869510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:30.874504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cbe45-711c-497c-a05c-3c842a359eb1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:30.918319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:30.919800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.920257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.920695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.934268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:30.936570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:30.940624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c93f-3b8b-41ee-87ee-9e7dcbe0a636 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:30.956751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:30.957932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:30.958981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:30.958981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:30.958981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:30.961015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 250/489] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:30.963865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:30.976897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:30.983781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:30.984691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:30.985166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:30.985628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:30.996870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:31.002563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:31.003454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:31.004561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:31.006953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 240/490] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:31.012592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.072880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a25bc-a973-4c39-8c93-3d3ec530b12e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.108663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.109529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.109805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.110119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.120894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:31.122283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7a28d-0da0-4a47-b996-575673550223 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:31.126000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:31.126914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:31.127751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 251/491] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:31.128405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.141350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.164299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.165370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.165847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.166312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.167148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.167743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.169369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.182646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 241/492] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.183814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.239103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676890b-61e6-43ba-b301-e68648ad884a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.242308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.275176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.275953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.276134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.276350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.277011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.277309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.278670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.287065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 252/493] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.291732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.300850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fb4b-8a62-488d-aa91-79814ef94000 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.336113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.336745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.337029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.337307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.337964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.338263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.339650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.347685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 242/494] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.348473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.370657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.405348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b73d2-b596-4577-8f02-07d5eddc40c8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.438493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.439106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.439379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.439679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.447386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.448843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.453187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015103f2-5df9-4056-872f-b09a1246f176 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e52f5653-eb70-4fc1-8d62-dac27ca09475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:31.461332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:31.462436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:31.463339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 253/495] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:31.464354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7643-2e76-4b5a-bfb8-a7ed2200582d None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.464354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7643-2e76-4b5a-bfb8-a7ed2200582d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.464354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7643-2e76-4b5a-bfb8-a7ed2200582d None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.469554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 254/496] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:31.469554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7643-2e76-4b5a-bfb8-a7ed2200582d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.473914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.495785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.496414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.496706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.496968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.508173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.510178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-de10e101-2faf-4b8a-b673-dbb4f3d98143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:31.524120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:31.525212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:31.526056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:31.526056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:31.526056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:31.526056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 243/497] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:31.526282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829d4-764a-4072-9617-d9395a193cda None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.526552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829d4-764a-4072-9617-d9395a193cda None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.526823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829d4-764a-4072-9617-d9395a193cda None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.528054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 244/498] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:31.528741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e829d4-764a-4072-9617-d9395a193cda None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.574367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7643-2e76-4b5a-bfb8-a7ed2200582d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.607699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.609008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.609746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.610112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.610396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.621831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.623292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.634237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e829d4-764a-4072-9617-d9395a193cda None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-20db478e-479b-4bb7-b746-dc7bfe54ccb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:31.637374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:31.638418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:31.639490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:31.639490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:31.639490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:31.639490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 255/499] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:31.639906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.640183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.640452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.657392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:31.658518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:31.672976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.673571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.673850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.674119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.674844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.675148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.676592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816642dd-4b7f-4f1b-9137-00e71ce907f3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.712685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 245/500] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.713888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.714173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.714447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.728500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 256/501] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:31.729484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.731711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:31.732902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:31.751241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.815570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 246/502] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:31.815570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.861685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080bc43-dc11-491f-98ff-3bad88c8a888 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.881441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:31.907031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.908297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.908587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.908944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.909693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.910292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.912030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.925086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270555b-12d8-465a-b01e-1bf3be91bc02 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:31.935210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 257/503] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.935210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:31.966395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:31.967028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:31.967308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:31.967659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:31.968354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:31.968756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:31.970105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:31.987519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 247/504] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:31.987519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.007865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.059335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3222-588b-4fb9-9cda-ae218600b844 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.097808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.098491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.098779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.099068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.099915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801396ce-5497-4eea-9814-db129c1dd9e9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.133081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.133722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.133997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.134268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.140871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.141668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.143273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:32.156025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:32.157107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 248/505] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:32.162938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.166565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.168116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.236596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.260856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e173831-29f6-4a0c-9bf0-ba32f8a2ad46 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.265334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 258/506] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:32.266158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.294769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.295386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.295696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.295968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.303223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.304692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:32.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:32.316619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 249/507] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:32.317506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.343460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.369112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41801d4-2a9d-47de-a0bc-3f8f9b212a2c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.402942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.403584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.404199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.404199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.413957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:32.415156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc5e5-b87e-4a1f-beac-20418284eb7d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:32.419062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:32.420197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:32.421039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 259/508] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:32.421710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.449400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.450015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.450296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.450574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.452445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.462283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.463784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:32.477496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:32.478362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:32.479201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:32.479201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:32.479201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:32.479201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 250/509] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:32.479430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.520996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f137-4375-405f-81df-7a8dfea0fbcd None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.554082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.554687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.554967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.555267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.556031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:32.556332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.557774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.565121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.578938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab243-2bbd-4c10-9ee2-64e543024c9f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.595337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 260/510] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:32.596203 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.617077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.617755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.618030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.618300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.628436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.629865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:32.643929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:32.645016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:32.646118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:32.646118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:32.646118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:32.646118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 251/511] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:32.646118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.685929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.699501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b86f2-fe70-4052-8dff-d7e49d82109d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.733021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.733615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.733886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.734150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.734861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:32.735161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.736630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.745475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f7a7-95c8-4aa1-866a-7a1a3d30cd5e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.753597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 261/512] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:32.754514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.783642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.784235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.784512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.784788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.785444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:32.785747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.787108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.794728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 252/513] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:32.795512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.806406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.856036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13037e9a-7d43-4140-a343-e934c71e18cd None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.890534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.891132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.891388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.891692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:32.892326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:32.892570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:32.892691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:32.893975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:32.895619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e604-e209-4bc4-9b6f-87f302224599 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:32.905213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 262/514] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:32.906051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:32.933410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:32.934254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:32.934529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:32.934801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.000273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.001641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.001944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60e76d-db49-46d4-9982-5115eb93a75f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.012621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.035773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.036371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.036675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.036943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.037573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:33.037873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.039224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.050700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 263/515] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:33.051455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.096366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.105163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 253/516] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:33.105163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.156784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f80d0-2e13-4751-9bd6-71144fd82e73 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.190699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.191291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.191596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.191865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.196476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b910-09e3-444a-bf4e-4f74ec2d6c8d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.228898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.229504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.229777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.230046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.230223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.239942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.241350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:33.256013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:33.257116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:33.258182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:33.258182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.258182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:33.258182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 254/517] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:33.258182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.259958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.261417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.313661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.359053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 264/518] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:33.360160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf5e50-f5e6-47e8-81f0-cfdfb812174d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.360292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.393388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.393985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.394262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.394529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.395157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.396628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.416908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 255/519] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:33 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:33.427800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.444497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.482236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebe36-7f28-44bf-8bdc-aff4338a98d1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.521339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.522015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.522355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.522691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.530830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.532441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.533816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18087615-a580-470b-865f-f10c6e7a971b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.544899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:33.545769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:33.547078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:33.548134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:33.549305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 265/520] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:33.550216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.588694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.589848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.589848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.591964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.609776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.611486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:33.627804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:33.628971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:33.629922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:33.629922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.629922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:33.631044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 256/521] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:33.632417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.668290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea5ad-bac6-4036-b59b-c5bf6b8b2b8f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.698232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.705679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.706283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.706555 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.706865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.707512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:33.707915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.709281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.721876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 266/522] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:33.727623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.740826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80401-e9ba-4477-a8c7-9bfd3c0bac4e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.777784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.779192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.779793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.780391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.792641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.794336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:33.810465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:33.811406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:33.812320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:33.812320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:33.812320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:33.812320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 257/523] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:33.812320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.828890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.839292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d57d1-8dcc-48bc-9845-4641aaa1d6ce None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.875131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.875769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.876079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.876319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.877009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:33.877315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.878757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.898078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 267/524] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:33.900168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:33.925240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee47d6-e5aa-4827-9007-d12a8e47f15c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:33.954355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:33.965477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:33.966087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:33.966358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:33.966623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:33.967256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:33.967568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:33.968992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:33.985983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 258/525] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:33.985983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.010373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390fee-4f8c-4941-8320-bd2711b1715a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.045776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.046460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.046739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.047010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.054073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.055569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.061749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:34.069204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:34.070327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:34.072113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:34.075462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 268/526] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:34.076313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.098324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d402fb-9c35-4682-b5e9-00b1299ff302 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.134502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.135406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.135976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.136253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.136889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.137189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.138676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.155244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 259/527] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.155244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.182260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cade-14c2-4a7e-baa9-1fd83b084e25 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.192610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.219186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.219918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.220118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.220386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.221215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.221516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.223051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.229859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 269/528] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.230442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.277560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191eff4-4589-44ab-9791-3f6481ddf9b2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.312611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.320100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.320719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.321646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.321927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.330051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.331723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:34.345611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:34.346658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:34.347506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 260/529] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:34.348562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.368107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8217c6-2d0e-48b1-bbfc-689e21ae9122 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.409663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.410816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.410942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.411246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.412084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.412450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.413957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.432986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 270/530] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.433895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.466579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.474904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3ca0-ee09-4645-aaa1-7fb90038edf3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.521429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.522684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.523180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.523980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.534679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.537359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.541708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88780045-5b2f-480a-8ea0-9ef13ef5770e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:34.554101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:34.555017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:34.556438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:34.559620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 261/531] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:34.560656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.586409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.586918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.587190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.587460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.588184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.588484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.589907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.605713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 271/532] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.605713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.637434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.691176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f224-4dc1-409a-bb89-1754f54f837f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.712326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.725124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4244827-a861-4ab8-adde-a41d9c6d517d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.732015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.732685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.732965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.733238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.767937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.769050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.769528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.770284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.771497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.772193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.774544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.790460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 272/533] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.792002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.822675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.824449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.897583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:34.919978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d9254-c073-413f-81ca-ca842d30f743 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:34.963379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 262/534] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:34.964676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:34.964782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:34.965340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:34.965621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:34.965940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:34.966613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=4d70f0f7e72a4d658218f9c8fcf64737) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:34.966920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:34.968500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:34.974994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 273/535] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/role_assignments?user.id=4d70f0f7e72a4d658218f9c8fcf64737&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:34.975904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:35.016893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:35.080681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d14e-bdbe-4f1c-a072-e634e59af410 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:35.124419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:35.125400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.125888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.126165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.126898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=c633e39c46f94f608a0887fe25312310) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:35.127206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:35.128675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:35.138500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 263/536] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/role_assignments?user.id=c633e39c46f94f608a0887fe25312310&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:35.173286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e40325-88d7-44ef-af9d-d8acf5c3de88 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:35.212681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:35.213321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.213597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.213865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.226221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:35.228374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:35.243969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:35.244956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:35.246232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:35.246232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:35.246232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:35.246232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 274/537] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:35.251103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:35.276474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:35.395954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0857-b2a6-489a-9bad-68120f913f00 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:35.435340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:35.436303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.436786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.437260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.438128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:35.438642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:35.440254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dd48-ba56-4e7d-98cf-bdfc334ec692 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:35.457725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 264/538] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:35.464023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:35.546725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e400-f285-4478-bd06-d77ed4b0b135 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.547032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e400-f285-4478-bd06-d77ed4b0b135 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.547376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e400-f285-4478-bd06-d77ed4b0b135 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.548736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 265/539] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:25:35.562696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:35.562868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.563179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.563468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.600629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7028c-c518-47ce-9229-1e6eb0051177 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:35.603509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:35.606650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:35.669688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:35.670867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.672364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.672740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.684435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:35.686083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:35.712085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 266/540] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:35.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:35.715228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:35.716297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:35.717786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 275/541] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:35.723338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:35.732097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:35.855625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f0634-6d7f-488d-a5bd-b65f386a6981 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:35.900078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:35.900906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:35.901319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:35.901720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:35.902621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:35.903065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:35.904637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:35.929447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 267/542] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:35.936050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.043920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.047893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dee40-562b-423e-a456-6b186a44d267 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:36.079559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:36.088284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:36.088908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.089166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.089449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.090159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=1e7a5e0bc9174566804a188cdcd08047) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:36.090464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:36.091930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:36.097968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 276/543] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:35 2022] GET /identity/v3/role_assignments?user.id=1e7a5e0bc9174566804a188cdcd08047&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:36.145800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:36.199501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37813ca-f710-4eae-af14-bdb236a7e469 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:36.250252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:36.250899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.251176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.251447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.272555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-251217c7-319c-41f7-9e2c-d9bc68522150 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:36.277440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:36.278320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:36.279118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 268/544] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:36.284671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.402721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d89e-893f-4af7-8b78-eb898e70bebe None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:36.442332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:36.442942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.443219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.443492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.444185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:36.444489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:36.445879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd4d07-e8f7-4f96-988f-97d0d383c649 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:36.453056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b490377-e839-442e-976e-2bd69edce13a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.453345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b490377-e839-442e-976e-2bd69edce13a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.453623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b490377-e839-442e-976e-2bd69edce13a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.454540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 277/545] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:36.455201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 269/546] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:36.460646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.460926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.461199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.464663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b490377-e839-442e-976e-2bd69edce13a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.494683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:36.497199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:36.598294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:36.622000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 278/547] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:36.681271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b490377-e839-442e-976e-2bd69edce13a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:36.714101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:36.729163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:36.729800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.730076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.730347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.744240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:36.745682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:36.760207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:36.761118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:36.761971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:36.761971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:36.761971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:36.761971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 270/548] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:36.767219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.888818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedae30-e798-40a8-944d-3f465daaf8c2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:36.939798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:36.940392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:36.940639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:36.940913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:36.941560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:36.941862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:36.943237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:36.957553 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 279/549] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:36.963376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:36.974467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.058364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.141301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdc242-42e0-47cd-b404-895e87159ad1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.158564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010e35f-2f1d-4a00-8911-df30e79d100d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.183402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.184314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.184926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.186026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.200472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.202328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:37.220335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:37.222005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:37.223335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:37.231324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 271/550] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:37.237288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.238262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.238899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.239175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.239443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.266600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:37.273784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:37.274725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:37.275574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:37.278522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 280/551] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:37.283828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.308475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.393275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7de1-5217-4537-b83f-a1b9b369ad0e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.398070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed052ba-827a-49a3-acee-2c2cd49dc921 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.401637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.437921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.439102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.439446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.439872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.440070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.440350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.440618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.440941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.441356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:37.441658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.442190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:37.442680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.443068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733328b2-fc62-4727-bcb1-fd14044078dc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.444596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85540270-33fd-473b-93f1-b881bd51285e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.459203 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 281/552] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:37.460761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7add5c-73d1-4c08-891b-7b141206088c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.461977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7add5c-73d1-4c08-891b-7b141206088c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.462475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7add5c-73d1-4c08-891b-7b141206088c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.465794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 282/553] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:37.466709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7add5c-73d1-4c08-891b-7b141206088c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.473832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 272/554] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:37.475293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.475825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.476297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.498575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:37.500139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:37.584627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 273/555] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:37.585807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.616111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7add5c-73d1-4c08-891b-7b141206088c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.623307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.662147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.662775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.663071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.663331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.675372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.676425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ae24fd96-3323-4b4e-ad43-afba67fa8d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:37.691917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:37.692860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:37.693755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:37.693755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:37.693755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:37.693755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 283/556] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:37.694559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224197c-3f19-442d-988e-0e4dbaec9c4e None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.694843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224197c-3f19-442d-988e-0e4dbaec9c4e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.695115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224197c-3f19-442d-988e-0e4dbaec9c4e None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.696645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 284/557] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:37.698283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224197c-3f19-442d-988e-0e4dbaec9c4e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:37.715610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f6f85-26ae-4f4a-bcc3-918e7fe08c8a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.718687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.765007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.765812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.766160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.766540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.828374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224197c-3f19-442d-988e-0e4dbaec9c4e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:37.839032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.840336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.872580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:37.876060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:37.876983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.877717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.877997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.878896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:37.879250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:37.880822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9f0cf-2f38-4837-8560-87c229bd01ea None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:37.896558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 285/558] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:37.898814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:37.898814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:37.898814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:37.919252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:37.920477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:37.950843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 274/559] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:37.951746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.003700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 286/560] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:38.003700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.014325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.070528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec0b8c-af8a-4ff7-a5c5-09cb5baf4767 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.111645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.123198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.123850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.124436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.124709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.128614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bad32-a2ca-41f3-b701-a49bb43952bb None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.142050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:38.148489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.150042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 275/561] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.150889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.170121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.171054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.171336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.171648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.180500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.182354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:38.197243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.198226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:38.199187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 287/562] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:25:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.199826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.277424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.278716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910a14-368c-4814-acc0-b8ac990dac7b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.314209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8c0-0c49-47ef-a0d4-c0991eb9d0f1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.321165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.321799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.322076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.322597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.334146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.335858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.351913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:38.352095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.353075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:38.353986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:38.353986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.353986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:38.354188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.354188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.354188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.354365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 276/563] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.354365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.358782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:38.358782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.359775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.368419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 288/564] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:38.369062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.404327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.464294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774b792-be25-403f-86d3-d3e53a65fb6d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.468589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184c84-eb75-455f-be1d-c01d305e0944 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.496021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.497921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.498612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.498840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.499105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.499957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:38.500254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.501663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.502399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.503017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.503291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.503575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.514023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:38.518910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 277/565] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:38.519142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.520113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:38.520945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:38.521581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.521662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 289/566] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.521662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.620112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.626426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc625-2fc6-44ba-9c7c-89b00c4a57a9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.626976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f73-9ef0-44aa-b763-5cb33199b80d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.660284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.660816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.660990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.661345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.661480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.661618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.661715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.661953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.662247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:38.662543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.663935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b106c-955a-4a9d-8bad-decaa196203e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.672730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.674169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.674620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 278/567] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:38.675778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8d4-45d4-4817-abc2-d0512924eca3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.676062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8d4-45d4-4817-abc2-d0512924eca3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.676333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d8d4-45d4-4817-abc2-d0512924eca3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.677785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 279/568] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:38.678476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d8d4-45d4-4817-abc2-d0512924eca3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:38.690058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.691238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:38.692372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:38.692372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.692372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:38.692372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 290/569] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.692372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.734042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.782766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d8d4-45d4-4817-abc2-d0512924eca3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.789212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62e0c-c35f-428e-a054-f2db07015187 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.815041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.815685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.815958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.816225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.822389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.822978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.823253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.823528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.824206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:38.824500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.825860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.826931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.828388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.834110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 291/570] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:38.835270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-aeecea1b-89cc-4024-a61f-210dce5a1435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:38.842402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:38.843344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:38.844329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:38.844329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:38.844329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:38.844329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 280/571] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:38.844954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.844954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.845131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.862411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:38.863534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:38.865559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.929536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 281/572] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:38.930922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:38.937930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1c7b-53a2-44ef-a4d8-e584c6e61dde None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:38.940544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:38.976390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:38.977264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:38.977535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:38.977802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:38.985085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:38.986530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:38.999607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.000487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:39.001387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 292/573] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.001887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.038127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaf9e-efec-46c6-a304-831f59059617 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.075075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.075721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.075974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.076239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.076873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.077168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.078817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.085813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.096666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 282/574] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.096666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.114358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59f0a-a29b-4562-b498-c02b8aa06212 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.149806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.150589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.150908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.151293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.162384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.163985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:39.179446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.181172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:39.182070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:39.182070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:39.182070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:39.182070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 293/575] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.182293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.200659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff68b-e693-4e98-922c-3f4e417b7f1c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.205115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.233836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.234427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.234700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.234966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.235619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.235917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.237256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.249176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 283/576] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.250125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.291432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dded69c-062e-42c9-8d97-e744910745b0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.306951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.324895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.325843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.326125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.328830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.328830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.328830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.330210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.342650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 294/577] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.343582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.350124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9ee92-1a2a-4ff8-85c7-e002d8f9ec0b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.384177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.384794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.385072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.385344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.392083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.393514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:39.404615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.405724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 284/578] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.406679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.424699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.448898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf7f5-6e52-4e85-bc29-9bc0a56831db None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.483769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.484364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.484634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.484909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.485537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.485838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.487195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.497990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 295/579] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.498755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.509630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b90-2e55-4c9e-974d-7f719ac75980 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.526578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.544794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.545410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.545682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.545944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.556045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:39.561126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.562245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 285/580] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.563296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.599412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a0f1a-17de-4138-afde-50ea155abb40 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.633786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.634458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.634686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.635010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.637695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.642467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.644073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:39.655915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.656998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 296/581] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.657926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.664377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d68b-60a3-4866-92a1-eea715655a58 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.699150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.700108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.700389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.700660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.701684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=5dccb9c74e7a45279ae6f5581a497a6d) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.701992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.703407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.708818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 286/582] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/role_assignments?user.id=5dccb9c74e7a45279ae6f5581a497a6d&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.709571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.760243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.762085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85e4-2367-40eb-9ecc-ae7508a928ff None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.799268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.800015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.800358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.800702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.801565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.801875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.803351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.822412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 297/583] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.823261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.833272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7c2d-c70f-4fcb-8410-00e5c3427d72 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.871305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.871966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.872244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.872517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.880079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.881496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.885574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:39.893585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:39.894535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 287/584] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:39.895486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:39.938307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f09dd-5d97-483a-a4fd-2a442e4c82ef None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:39.975490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:39.976398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:39.976871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:39.977315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:39.978223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:39.978767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:39.980320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:39.989087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 298/585] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:39.990215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.000943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17894f-8eda-43ea-8455-e6755fd9df94 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.002759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.038823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.039824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.040243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.040669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.041353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:40.041656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.043130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.055419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 288/586] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:40.056222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.107320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500a65-129c-4621-ae13-d0b601db85b9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.126006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.149604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.150159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.150440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.150716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.164137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3bff-f745-4ae8-9a67-2303141c6446 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.164662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.165781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:40.181708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:40.182689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:40.184054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:40.184054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.184054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:40.184054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 299/587] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:40.184054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.208955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.209723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.210100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.210378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.211098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:40.211430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.212891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.230456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 289/588] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:40.231238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.257973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.297641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0233ca-01c1-4cb7-98d5-f93861ceb9c9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.336155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.336810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.337089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.337358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.340212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac6dcf-7ee9-4a05-8bad-d564749a0eab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.348252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.349686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:40.363769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:40.364747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:40.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:40.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:40.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 300/589] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:40.365662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.384369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.385043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.385284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.385551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.389082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.400347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=6e110ca44c21448c807e788a08126a99, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.401724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.422707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 290/590] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:40 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:40.422707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.501921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892c07-a3ef-4627-bbec-c8664d5569e2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.525284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.552544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.553320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.554242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.554630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.556094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:40.556507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.558422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.573448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5497b2-fd0c-4a44-bc47-b11d930f8ae9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.575021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 301/591] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:40.576171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.621345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.622988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.623649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.624197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.639124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.641304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:40.662145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:40.663149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:40.665086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:40.665086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:40.665086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:40.667606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 291/592] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:40.668632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.690240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.712895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3611-b892-43e4-aa65-1326c4b34b51 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.755066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.755715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.755993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.756263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.756936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:40.757239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.758657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.770710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 302/593] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:40.771344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.780162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edc08b-8353-422e-b618-9440e4413711 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.806808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.820796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.821926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.822466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.822982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.831033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.832875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:40.845515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:40.846437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:40.847361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:40.849898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 292/594] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:40.851025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.883704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdce10-d95e-44c1-a609-6f4ac5ec1132 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:40.926322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:40.927121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:40.927402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:40.927713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:40.928504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:40.928805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:40.931738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:40.941861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:40.950715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 303/595] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:40.951589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:40.968894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b22d8-3e15-4fa5-902d-1cac2aa9f331 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.004883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.005896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.006429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.006941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.015629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.017342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:41.029897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:41.030821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:41.031808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:41.034026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 293/596] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:41.035064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.079988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92fcb9-59da-4269-9f03-afaac973ba62 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.083972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:41.132435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.133068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.133365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.133636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.134363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:41.134958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.136206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.154321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 304/597] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:41.155204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.155995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccfc3e-d037-48a0-8c8e-8b2042b49766 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.197928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.198536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.198791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.199001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.208460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.210074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.220572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:41.224983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:41.225869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 294/598] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:41.227907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.279022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747c08-01ac-4499-be61-544daaca13db None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.329283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.330162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.330448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.330724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.331580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:41.331890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.333941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.347216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44d896-8136-4eb1-be45-c6400c1a5ca6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.349235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:41.358780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 305/599] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 17 08:25:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:41.359946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.393117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.394643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.395418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.395935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/4d70f0f7e72a4d658218f9c8fcf64737/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.416392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=4d70f0f7e72a4d658218f9c8fcf64737, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.418728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.443575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 295/600] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:41 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/4d70f0f7e72a4d658218f9c8fcf64737/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:41.443575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.536935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678dd9d-d8d6-468c-aabf-1a155dd3a2db None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.582407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:41.629151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.630142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.630645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.631112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.632111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:41.636231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.637955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.660595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fecb5-267d-4772-b954-b9d2cfeb21d9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.662146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 306/601] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:41.673173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.704237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.705637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.705918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.706333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.728245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.729696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6e6bb859-ef9a-44cc-9c15-ed5489277b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:41.761642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:41.762671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:41.763609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:41.763609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:41.763609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:41.765804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 296/602] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:41.767212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7957-97f6-4495-b31a-f464f4984363 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.767721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7957-97f6-4495-b31a-f464f4984363 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.768207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db7957-97f6-4495-b31a-f464f4984363 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.770237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 297/603] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:41.771186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7957-97f6-4495-b31a-f464f4984363 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:41.775246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:41.884243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40850ed-cda0-4fa6-a8c6-b1f594c07a35 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.922010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db7957-97f6-4495-b31a-f464f4984363 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:41.931939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:41.932549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.932789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.933055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/c633e39c46f94f608a0887fe25312310/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.949375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=c633e39c46f94f608a0887fe25312310, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:41.950892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09ffc-8e7a-4738-bd29-3fb49bc7a1b0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:41.970810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 307/604] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:41 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/c633e39c46f94f608a0887fe25312310/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:25:41.972209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:41.972536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:41.972864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:41.996037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:41.997436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:42.022431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.024769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.025684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:42.026979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.028159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.029672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:42.032273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:42.034270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:42.076416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 298/605] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:42.082769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.089961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 308/606] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:42.213255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:42.263520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9950c8-21d7-4204-9ccd-71c7a75d59c3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:42.299864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.300895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.301371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.301836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.309861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:42.311615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:42.323411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:42.324366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:42.325288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:42.327691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 299/607] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:42.338751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.415996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.482207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308121-657c-4a70-8eca-bf0f8b659789 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:42.525825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.526674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.527363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.527677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.528643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:42.528948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:42.531294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f2524-824e-4ab1-9dfc-c85dcf65a295 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:42.533079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6923-a612-4806-9d89-0be1f26a33ef None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:42.548080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 309/608] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:42.549387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6c4d-1ac9-488c-8a81-e019ab47af85 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.549679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6c4d-1ac9-488c-8a81-e019ab47af85 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.549932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6c4d-1ac9-488c-8a81-e019ab47af85 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.551395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 310/609] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:42.557390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.557670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.557939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.571701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:42.581323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:42.582752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:42.585362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.587675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.588174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.588640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.601256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:42.603752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:42.610531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:42.611450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:42.612329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:42.615666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 300/610] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:42.616732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.683682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 311/611] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:42.685054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.734462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4161a-368a-4786-bccf-91eeaed6d295 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:42.800464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.801157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.803115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.803401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/1e7a5e0bc9174566804a188cdcd08047/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.809910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16ed6-c876-41fb-807b-d02c408dc718 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:42.831335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=1e7a5e0bc9174566804a188cdcd08047, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:42.832774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:42.846889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:42.847967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:42.848432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:42.848948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:42.849888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:42.850378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:42.852204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:42.862636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 312/612] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:42.867609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 301/613] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:42 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/1e7a5e0bc9174566804a188cdcd08047/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:42.870285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:42.892417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.007480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d00e-6a61-4e51-8dd6-e13494bc8210 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.044145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.044794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.045067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.045335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.057595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.059082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:43.075740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:43.076810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:43.078093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:43.078093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.078093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:43.078093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 313/614] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:43.084635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.090395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.138354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.178632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.214649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102744a-7427-4b36-92c0-7771f0e2e69a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.225029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b379-e77a-4118-94ec-74d742345336 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.250486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.251095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.251370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.251665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.252302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:43.252594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.253960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.266407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.267352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.267874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.268344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.271056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 302/615] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:43.272336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.289566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:43.295783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:43.296742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:43.297607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:43.300380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 314/616] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:43.317013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.375836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.387592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef28a4-14fc-4ab7-a714-85f52039505b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.418880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.419519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.419877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.420089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.428268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.429693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:43.441521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:43.442502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:43.443497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:43.447644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 303/617] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:43.449015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.524040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2462db-f17c-4995-8899-e269f4dbf97b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.553110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854073d-6da1-416a-b8e2-a732ca240861 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.560054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.593124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.593124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.593124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.596314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.597029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:43.597340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.598789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.607976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.608084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.608307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.612157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.612157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:43.612157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.612157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.627568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 315/618] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:43.640281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 304/619] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:43.641835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.643101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.679902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.764293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf7ae-8a06-4312-b7ef-a610f16e8a45 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.769599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c191eb-b706-4259-a376-37e4a0696734 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:43.799001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.799585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.799874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.800155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.816372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.818044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.832472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:43.833108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:43.833386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:43.833657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:43.845138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:43.846735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:43.850757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:43.852479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:43.853605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:43.853605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.853605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:43.862080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:43.863228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:43.864367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:43.864367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:43.864367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:43.864367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 305/620] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:43.864766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 316/621] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:43.870427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.872654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:43.919317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:43.988414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c558-ce52-4df9-9b0a-c1713d88b6d5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.007889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.021046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6cb5-7a7c-41c9-9d0b-0fdff967541b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.023256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.024525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.024872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.025204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.025924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:44.026299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.027764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76731-8881-4dba-90d5-a8bb391fe31e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.040327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 317/622] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:44.044859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35188-5670-4cb6-ad7e-69b0782b1445 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.045221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35188-5670-4cb6-ad7e-69b0782b1445 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.045564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35188-5670-4cb6-ad7e-69b0782b1445 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.047174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 318/623] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:44.051988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35188-5670-4cb6-ad7e-69b0782b1445 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.062625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.063228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.063506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.063839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.064543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:44.064843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.066320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f383ec-851b-4756-aa33-305ad8492008 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.084838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 306/624] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:44.086765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.087099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.087372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.106332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:44.108035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:44.155173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.163027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35188-5670-4cb6-ad7e-69b0782b1445 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.187685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 307/625] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:44.188785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.210725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.212150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.212465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.212773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.230184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.231668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:44.257105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:44.259415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:44.261717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:44.266501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 319/626] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:44.268898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.302694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.356851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507fcfa-9720-4da4-aa10-18fe16937d77 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.378161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7407889-035c-461f-8496-8f970bb8ff3e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.394395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.395136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.395416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.395873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.403641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.405170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.416419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.417025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.417300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8d3639af-758e-459a-ab86-a2ffab31d63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:44.417463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:44.418350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:44.419330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:44.420229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.420229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:44.420229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.420229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98f741-f495-4ec3-8fee-f53f6a7bd395 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.423348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 308/627] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:44.424624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a000bb-2a9d-45f0-a881-ddac3332b30c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.424899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a000bb-2a9d-45f0-a881-ddac3332b30c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.425171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a000bb-2a9d-45f0-a881-ddac3332b30c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.427307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 309/628] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:44.428020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a000bb-2a9d-45f0-a881-ddac3332b30c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.438075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 320/629] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:44.439271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.443901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.444166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.462733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:44.464062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:44.473432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.535860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 321/630] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:44.539600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a000bb-2a9d-45f0-a881-ddac3332b30c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.544565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.554657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.577916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.578504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.578784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.579058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.579779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:44.580458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.582101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.598877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 310/631] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:44.598877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.673535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2b2c0-4708-4fef-90eb-ffbe6b013a18 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.709906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.710686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.711062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.711991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.727810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.743251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe35d-927f-4e17-b6c9-8f060842fc31 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.779244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.779906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.780184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.780497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.792142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:44.797388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:44.798316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 311/632] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:44.799769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.806443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.808180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.838208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.909782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78649-6875-48bd-b8d5-125a4b48ff1f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:44.916863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 322/633] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:44.917695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:44.949532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:44.950179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:44.950454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:44.950723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/5dccb9c74e7a45279ae6f5581a497a6d/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:44.965839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=5dccb9c74e7a45279ae6f5581a497a6d, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:44.967267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:44.967380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:44.991720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 312/634] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:44 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/5dccb9c74e7a45279ae6f5581a497a6d/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:44.991720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.046796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54561-ce3e-4e87-98b1-448d3e267bdc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.094413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.094943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.095214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.095562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.096245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:45.096545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.098255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.113869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 323/635] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:45.114965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.118090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.144413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc625b5-1aa1-48d1-869f-052758fcc3f7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.185487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.186120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.186396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.186667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.198306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:45.202771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.203750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 313/636] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:45.205693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.232521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3fa0e-cff8-44fb-bbff-b9038d316761 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.240502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.272801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.273434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.273722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.274582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.284622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.286070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f3cb9c7e-08d7-4ba8-ab65-1910d62202f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:45.300745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:45.301736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:45.302642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:45.302642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.302642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:45.302642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 324/637] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:45.303204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d9d-3b13-4531-888e-6adfb2c667b5 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.303361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d9d-3b13-4531-888e-6adfb2c667b5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.303519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256d9d-3b13-4531-888e-6adfb2c667b5 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.308702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 325/638] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:45.309472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256d9d-3b13-4531-888e-6adfb2c667b5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.323923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78ab4-b49a-4784-a9e7-8b7cac89ab5b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.360659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.361768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.362236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.362728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.373377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.375178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.378051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:45.392185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:45.393350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:45.394458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:45.394458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.394458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:45.395947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 314/639] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:45.396717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.419982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256d9d-3b13-4531-888e-6adfb2c667b5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.460390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.461016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.461319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.461601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.462362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:45.462662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.464171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a81979-b975-4a40-b282-50be56ab83a5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.477609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 326/640] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:45.477609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.477609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.477609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.497113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:45.498302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:45.504895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19ce6-2c20-44e7-8f6a-9178d54079ab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.514187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.543388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.544037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.544672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.544960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.545764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:45.546072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.547443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.561878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 315/641] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:45.562909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.575569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 327/642] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:45.577539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.634576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.683419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab77bf-4ff6-4a62-b650-63c5a3eb3756 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.708494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5733f0-c17d-4d95-a49c-e4545ca538ba None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.722571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.723737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.724148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.724578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.725349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:45.725893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.727529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.739931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 316/643] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:45.741273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.751298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.752278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.753234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.753758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.768194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.770832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:45.789350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:45.790373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:45.791299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:45.791299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:45.791299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:45.792865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 328/644] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:45.796312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.799864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.866077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b42aa-cd5d-40d4-8d74-3a29c0f0f62b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.884734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:45.905789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.906420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.906695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.906962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.913689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.915668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:45.927472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:45.928395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:45.935202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:45.935794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8fbd-7667-4069-a461-4dcd6009d185 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:45.935889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 317/645] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:45.935889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:45.974122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:45.975062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:45.975339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:45.975783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:45.984243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:45.985688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:45.998232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:45.999186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 329/646] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:46.000759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.038077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6ed1-4883-47fb-8026-9cac37de900f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.065744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.079081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.079712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.080253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.080521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.081161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.081458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.082806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.095530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 318/647] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.101168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.110455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58209-9687-4fdc-8115-da49f7ce0215 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.137850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.145734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.146566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.146842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.147112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.158732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:46.166169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:46.167176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 330/648] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:46.172247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.207234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff31bf-81a9-4a34-a863-b20ad0c8f3ab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.242610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.243432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.243750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.244025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.244702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.245004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.246767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.258547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 319/649] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.259241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.283940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd1b1-1834-4e9c-bf59-3ca552aacbad None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.307257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.321441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.322133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.322475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.322818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.323653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.324029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.325520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.343773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 331/650] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.349018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.360567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.367858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21932802-b5e6-401d-96ae-6a0876aff651 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.404734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.405466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.405802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.406079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.413999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.416337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:46.428012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:46.433990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 320/651] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:46.435183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.462094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c32e-2189-48ba-9343-d581cf42b672 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.498282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.499064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.499493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.499785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.500441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.500728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.502073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.515242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 332/652] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.515242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.540359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca10ea-76ef-461d-8c98-773ab53946a2 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.562061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.575606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.576352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.576756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.577038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.577766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.578079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.579527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.585902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 321/653] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.587277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.622490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.665604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d3568-58c4-4fa0-90ed-e724c8364e14 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.719873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.721468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.721899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.722352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.726686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a579b2-3725-432f-8fc2-a23bee1a3411 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.773286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.775042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.775318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.775650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.776420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:46.776688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.778587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.804553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 322/654] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:46.805743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.809426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.810962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.867781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.899644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:46.927145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d08fe9-f9b7-480a-801d-a11f53db5cc5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:46.936974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 333/655] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:46.938309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:46.964801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:46.965563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:46.965958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:46.966432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:46.977895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:46.979565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-547f9b5d-03c2-4cba-afb1-72e103a10de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:46.995781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:46.996978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 323/656] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51d4-55e1-429c-beef-9cdf88f8e408 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51d4-55e1-429c-beef-9cdf88f8e408 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51d4-55e1-429c-beef-9cdf88f8e408 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 324/657] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:47.002925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff51d4-55e1-429c-beef-9cdf88f8e408 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.048315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951c18f-ee52-4ed5-87e5-bc915d256c88 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.084797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.085403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.085678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.085945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.098606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.114002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff51d4-55e1-429c-beef-9cdf88f8e408 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.144696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.151423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.152219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.152496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.152764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.163656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.165118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.168392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.169839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735c263-2fae-44eb-8dc4-27d5f83950f3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:47.179425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:47.180960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:47.182391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:47.182391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:47.182391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:47.182391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 325/658] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.182391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.283465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 334/659] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:47.285244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.285732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.286221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.291146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518ad18-613c-45e2-a4aa-fbd42159f97e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.307322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:47.308654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:47.330575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.331448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.331756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.332032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.332840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:47.333154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.335092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.344883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.354855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 326/660] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:47.355417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.383613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 335/661] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:47.384260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.406606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.466629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f231d-4758-497d-96a8-fb8d838f5803 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.502797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.503666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.504091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.504553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.505195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:47.505501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.506859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.519163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a6b1-a3af-4ff1-a170-521dc73a5479 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.523926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 327/662] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:47.524804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.565716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.566700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.567174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.567727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.583165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.585470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:47.608560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:47.609503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:47.610393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:47.610393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:47.610393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:47.612629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 336/663] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.614182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.643607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df169f-5c0e-4dda-976e-8684937c0e87 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.645306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.648806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.683167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.684080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.684506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.684951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.692952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.694392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:47.705892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:47.706860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 08:25:47.707852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:47.711864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 328/664] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.713358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.731050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe42-8e08-4275-b4c7-20517901304f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.768170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.769027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.769300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.769570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.776832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.778270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:47.790857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:47.791857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:47.792761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 337/665] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.793533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.833793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832013-3285-4060-9709-d85fac6ae540 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.870183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.870789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.871061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.871330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.872199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:47.872325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:47.873628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:47.885535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 329/666] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:47.886128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.891885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.910392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a5bd-a33b-484e-b396-6f2f9804f99b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:47.910998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:47.944809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:47.945431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:47.945740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:47.946015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:47.956589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:47.962302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:47.963246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 338/667] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:47.968749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:47.998060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6eee0a-b6b5-42a6-bfe5-892b66b61cad None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.034547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.035296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.035701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.036068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.036944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.037342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.038893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.058163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 330/668] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.058815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.075476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e9e70-ca53-4fc9-947e-ee846322e9e5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.111858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.112466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.112743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.113015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.113709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.114014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.115443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.128812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 339/669] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.134716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.138290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.146355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.165733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0e9d4-14a2-4477-be69-4d4776780061 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.200071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.200699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.200976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.201242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.208127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.209557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:48.221059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:48.221960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 331/670] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:48.227864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.253919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5a98a-da85-4afd-94b2-cc2a02c10be3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.291592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.292190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.292465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.292734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.293394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.293703 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.295057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.307726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 340/671] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.307726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.334950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0eda5-c818-472d-8b8f-526878b851d8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.371223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.371855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.372133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.372402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.373090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.384407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.411945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49886b9-26ee-4a5a-8de5-3b3ba00c6b19 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.444834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.447420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.448859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.449460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.449736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.450002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.450852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=4d70f0f7e72a4d658218f9c8fcf64737) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.451036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.452469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.459176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 341/672] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/role_assignments?user.id=4d70f0f7e72a4d658218f9c8fcf64737&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.459791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.576482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09130-c788-490f-a05b-e4645c7d9aa2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.601154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 332/673] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:48.601154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.618873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.626423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.627034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.627320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.627933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.628959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.629268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.630688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.644063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 342/674] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.644685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.664034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.733413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615b39-70cc-4546-a0eb-08e47e7f3849 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.752152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651027-27dc-41e6-83a5-80c51e4e693d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.771217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.771882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.772158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.772427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.782643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.784137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.787961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.788688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.788967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.789235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e96b1305-16de-4ff6-8e52-6b25882186dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:48.798947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:48.799966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:48.800896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:48.800896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:48.800896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:48.800896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 333/675] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:48.801670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b56b3-949d-4481-ba05-6ffeac28e80d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.801670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b56b3-949d-4481-ba05-6ffeac28e80d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.801843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b56b3-949d-4481-ba05-6ffeac28e80d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.803178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 334/676] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:48.807690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b56b3-949d-4481-ba05-6ffeac28e80d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.808441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.809938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:48.828554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:48.829534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:48.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:48.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:48.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:48.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 343/677] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:48.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:48.877794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.917352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:48.929100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b56b3-949d-4481-ba05-6ffeac28e80d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.934517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971d9a-3a6c-4242-8999-8173312bef1a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:48.966468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.967075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.967465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.967867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.968589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=c633e39c46f94f608a0887fe25312310) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.968773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:48.968899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.969346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.969618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.969883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.970369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61e221-cc2e-456d-a2a5-4d747aff954a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.970535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:48.970797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:48.972185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:48.983796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 335/678] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/role_assignments?user.id=c633e39c46f94f608a0887fe25312310&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.983796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:48.983796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:48.983796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:48.995357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 344/679] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:48.996533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.004683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:49.006205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:49.087022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 336/680] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:49.088369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.111590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281167-0664-40f0-8b8a-641437bb8311 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.112436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.148645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.149417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.149762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.150029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.150732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:49.151032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.152469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.165371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 345/681] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:49.176498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.219656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.239227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf81a2-6861-4d09-b32c-585d3531920b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.284555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.285188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.285992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.286269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.297966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.300007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.301433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e89a-1918-45a0-b87b-e9eafe591003 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:49.317109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:49.318110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:49.319093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 337/682] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:49.326916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.356351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.357405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.357888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.358455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.367588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.369499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:49.382151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:49.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:49.384066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:49.386662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 346/683] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:49.392349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.436430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.458214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d337-7391-4d33-b04e-1154d0e9fdde None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.497452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.498599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.499108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.499696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.500642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:49.501146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.502866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.522609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7580a9-b0c3-4324-a322-4dec9a063ca1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.527868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 338/684] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:49.529008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.533514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.561495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.562101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.562374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.562644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.563334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:49.563661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.565188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.583867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 347/685] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:49.583867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.649593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e89f-ab08-4914-bffd-3fee6a3008c8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.682187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.685232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.686203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.686683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.687152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.698357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:49.703438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:49.704397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:49.705525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:49.706167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf132-adef-4df3-863d-2b34e3e23ddc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.708314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 339/686] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:49.709355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.755660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.756267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.756715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.757068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.783381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.811996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a982626-1955-43d7-85fc-46f7fa73259e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:49.848257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.849707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.850575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:49.851232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:49.851666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:49.851969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:49.852821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=1e7a5e0bc9174566804a188cdcd08047) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:49.853135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:49.854546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:49.861045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 340/687] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/role_assignments?user.id=1e7a5e0bc9174566804a188cdcd08047&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:49.868805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:49.961747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:49.996400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b912cdf-015b-4780-994d-39dd34d781ae None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.021218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 348/688] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:50.032628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.035912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.041294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.047737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.056238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 341/689] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:50.062129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.169897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309bf76-ad83-48fa-ae9d-e769ee88dc55 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.191121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0599b5-9791-432f-ab5d-c1e36d9b1e6e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.207981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.208721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.208999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.209266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.221341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.222872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.231095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.231768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.232050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.232322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:50.239413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:50.240484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:50.241403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:50.241403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:50.241403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:50.241403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 349/690] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:50.248106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.248343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.249560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:50.269211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:50.271589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:50.273787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:50.273787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:50.273787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:50.273787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 342/691] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:50.279906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.299308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.339348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.385192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa5d4-23b4-4514-b649-65fbe3169aa0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.429631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eff6f-ae6c-409d-9cef-1160e9ba1008 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.449831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.450440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.450718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.450983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.451649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:50.451953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.453318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.476788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 350/692] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:50.483964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.520254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.520882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.521151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.521427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.522076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:50.522374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.524322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a1a62-c126-45a8-8ad7-1dae42ce39e1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.544628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 343/693] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:50.547455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190236-3224-4aa0-9cdb-ccc5633eabba None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.547782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190236-3224-4aa0-9cdb-ccc5633eabba None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.548056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190236-3224-4aa0-9cdb-ccc5633eabba None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.549508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 344/694] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:50.552350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190236-3224-4aa0-9cdb-ccc5633eabba None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.602821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.612634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aaaca-87b5-4dcb-8d8c-08cdfcd71536 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.648628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.649804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.650086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.650365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.657384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.658842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2bebb91c-ef7c-4a8e-88ba-da42e94922d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:50.671209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:50.672265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:50.673257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:50.677108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 351/695] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:50.678358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.678633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.678904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.697787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:50.698881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:50.708477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190236-3224-4aa0-9cdb-ccc5633eabba None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.710016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.749421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.750362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.750841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.751380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.761068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.762738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:50.781279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:50.782526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:50.783744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:50.785748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 345/696] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:50.786681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.795977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 352/697] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:50.797500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:50.910458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fcd9-a92c-42ce-be35-1f4f1aeac811 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.937604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:50.955594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc26ac-79d2-458a-9b0e-3d7f86f75ada None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:50.990865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:50.991754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:50.992211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:50.993204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:50.994075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:50.994529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:50.996104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.009347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.009948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.010228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.010503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.011202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:51.011517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.012959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.015898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 353/698] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:51.023626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.039460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 346/699] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:51.041208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.079884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.181425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05607969-6bb7-422d-a097-dc4542c2d194 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.188182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d008-ecfe-47c5-8d30-323d0f1f21ab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.223999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.224532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.224809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.225079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.227405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.228117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.228399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.228670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.229488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=5dccb9c74e7a45279ae6f5581a497a6d) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:51.229797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.231205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.237708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 347/700] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/role_assignments?user.id=5dccb9c74e7a45279ae6f5581a497a6d&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:51.238570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.239107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.340319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.342141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.380762 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.407635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5673b0-5771-4dfd-980e-16a0d12b5a8f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.450665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.451306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.452310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.452310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.452490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.454541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f7dbb6e7-297b-4784-9561-e3ca46435bec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:51.471260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:51.472553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:51.473436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 348/701] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:51.474325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e40b-fcfd-4636-9a6c-5b4601ac298e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.474325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e40b-fcfd-4636-9a6c-5b4601ac298e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.474325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e40b-fcfd-4636-9a6c-5b4601ac298e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.475619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 349/702] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:51.478995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 354/703] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:51.484800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.485144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.485428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.485699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.509578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:51.510792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:51.534626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.599158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 350/704] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:51.600064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.606055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3868a-4410-47a0-9580-0663df5e65b4 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.653376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.653996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.654695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.654972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.656043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:51.656354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.658600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.669021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 355/705] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:51.678263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.700127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.720524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc23769-b2e2-479d-8384-811f682b2935 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.761638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.763329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.763696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.763971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.783065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.784561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:51.814250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:51.816526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:51.818628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:51.818628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:51.818628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:51.818628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 351/706] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:51.821998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.879780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7ef90-7c98-4e51-b63e-b4c8543b19b4 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.888459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.928240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.929197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.929663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.930135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.931000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:51.931496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:51.933085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:51.943928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 356/707] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:51.944758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:51.950837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c90b8-f84d-4456-ae4f-5aca36a91408 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:51.987766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:51.997245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:51.997929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:51.998210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:51.998478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:51.999163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:51.999438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.002378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.027862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 352/708] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:52.033285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.146516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5c0f-4fae-49ca-af82-d96523461227 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.181040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c2d2-ca9d-4f97-b7a5-453474f2ccdc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.190845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.191487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.191782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.192053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.204320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.205971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:52.220653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:52.221657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:52.222577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:52.222577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:52.222577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:52.222577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 357/709] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:52.228080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.231574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.231853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.232135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.239426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.240892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:52.252967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:52.253901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:52.254813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 353/710] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:52.258890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:52.265353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.340094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:52.351634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f2f1-dcd2-48df-9d76-22dd354ec50b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.371050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8973b-20c7-4bf3-b258-72f9f8b28618 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.389051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.389633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.389974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.390371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.391081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:52.391448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.392910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb3c89-2f76-4aa5-9947-1f08afdc9983 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.406174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 358/711] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:52.407708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4127-f98a-4a64-881e-c3c9bcdad8f7 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.408062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4127-f98a-4a64-881e-c3c9bcdad8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.408398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4127-f98a-4a64-881e-c3c9bcdad8f7 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.408873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.409718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.410211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.410683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.411669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:52.412198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.413785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 359/712] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:52.414044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c87f8-4d8d-43d5-89c1-2db3f0b48b98 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.414668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4127-f98a-4a64-881e-c3c9bcdad8f7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.427727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 354/713] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:52.429310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.430339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.430819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.450135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:52.451661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:52.505747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:52.525657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 355/714] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:52.525657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.566887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:52.567962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4127-f98a-4a64-881e-c3c9bcdad8f7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.625542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a77daa-7f4a-4082-ac40-6cbce2e3e063 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.661009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.661614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.661893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.662166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.662886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:52.663192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.665340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.671769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 356/715] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:52 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:52.704463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.705374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.705652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.705921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.706578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.708051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:52.751890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 360/716] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:25:52 2022] POST /identity/v3/users => generated 254 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:52.818708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:52.944903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dffc7-2219-41c2-9eac-f6059a90e6a4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:52.956582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:52.994156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:52.995154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:52.995672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:52.996137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] PATH_INFO: `/v3/services/network` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:52.996923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:52.998584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:53.008338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:53.009378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:53.010214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:53.015824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 357/717] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:52 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:53.019227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:53.131851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab0a9-a08e-4813-a6e4-bf2d293ab815 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:53.170551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:53.171175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:53.171461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:53.171765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:53.172406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:53.172705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:53.174083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dfc6c-03fd-4cb8-ac74-d289d6fb19b6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:53.179273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 361/718] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:25:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:53.184962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:53.310412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bdef7-2d87-409b-908f-c15e28adc953 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:53.344930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:53.345532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:53.345805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:53.346069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:53.346688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] RBAC: Adding query filter params (type=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:53.346984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:53.348359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851adbb-c39b-4c27-97ff-e5d0dfbaaa0a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:53.354248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 358/719] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:25:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:53.700296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74dc97-a225-47ee-a74d-ab20f9fe9f03 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:53.700635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74dc97-a225-47ee-a74d-ab20f9fe9f03 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:53.700843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74dc97-a225-47ee-a74d-ab20f9fe9f03 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:53.702437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 362/720] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:53.707973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf9013-df4a-4dd1-8412-8959e1105b34 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:53.708438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf9013-df4a-4dd1-8412-8959e1105b34 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:53.708526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf9013-df4a-4dd1-8412-8959e1105b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:53.736549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1adf9013-df4a-4dd1-8412-8959e1105b34 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:53.737757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1adf9013-df4a-4dd1-8412-8959e1105b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:53.770306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:53.822708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 359/721] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:54.105918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74dc97-a225-47ee-a74d-ab20f9fe9f03 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.108954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:54.194621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d14f-92bc-4d05-8b90-83413c1d9983 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.195298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d14f-92bc-4d05-8b90-83413c1d9983 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.195827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d14f-92bc-4d05-8b90-83413c1d9983 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.197674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 360/722] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:54.203065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471469-3340-4824-9b05-bed1403e873b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.203340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471469-3340-4824-9b05-bed1403e873b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.203646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471469-3340-4824-9b05-bed1403e873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.237596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74dc97-a225-47ee-a74d-ab20f9fe9f03 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:54.246867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5c471469-3340-4824-9b05-bed1403e873b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:54.248100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5c471469-3340-4824-9b05-bed1403e873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:54.292188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:54.292823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.293097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.293368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.314388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:54.319211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:54.320251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:54.321143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:54.322334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 363/723] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:54.328425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.400479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 361/724] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:54.410213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:54.452209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e99f18-9ff3-4fd6-ba75-e282576054f0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:54.487738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:54.488340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.488612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.488883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.489541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:54.489838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:54.491192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:54.503933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 364/725] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:54.505474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471469-3340-4824-9b05-bed1403e873b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.627743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:54.637325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471469-3340-4824-9b05-bed1403e873b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:54.688613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:54.689203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.689481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.689751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.705576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:54.707124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:54.725346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:54.727314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:54.728254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:54.728254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:54.728254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:54.731668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 362/726] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:54.733096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.740557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.843042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972854ab-8233-4571-a4b0-d2618b14b811 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:54.869317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:54.881025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:54.881634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:54.881945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:54.882267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:54.884500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:54.884822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:54.886182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:54.903624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 365/727] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:54.904846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:54.990634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809d10-e11d-4574-a8cd-2f797d822ecb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.010890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c47d-cceb-40ba-bf2f-0c54004fdc07 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.048004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.048630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.049006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.049277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.056822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:55.058260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:55.082068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.082704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.082984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.083257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.083987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:55.085404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5637-0595-408f-a887-b1957fa9e79d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:55.118587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 363/728] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:25:54 2022] POST /identity/v3/services => generated 251 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:55.120499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ead67-75f5-4575-af65-324f7fcc74c2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.121035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ead67-75f5-4575-af65-324f7fcc74c2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.121568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ead67-75f5-4575-af65-324f7fcc74c2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.128386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 364/729] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:55.130228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.130770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.131240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.146680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:55.154748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:55.156632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:55.195024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:55.197381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:25:55.198368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:55.201811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 366/730] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:55.203106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:55.255484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:55.260003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 365/731] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:55.317216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bae469-9363-4e63-bb51-685fc59edf42 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.355126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.355752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.356027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.356299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.357035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:55.357337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:55.358793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:55.383684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 367/732] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:25:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:55.385339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:55.491800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c8999-e3b4-4170-a98a-150b14b8e038 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.520628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:55.528049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.528665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.528945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.529219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.613651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:55.615419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ade1cb-88ae-425f-b37c-25267bd53304 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:55.617895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:55.723309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 366/733] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 08:25:55.724917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb81a-1c4b-4ace-a312-782305ce8623 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.725415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb81a-1c4b-4ace-a312-782305ce8623 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.726374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb81a-1c4b-4ace-a312-782305ce8623 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.728146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 367/734] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:55.728560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3b044-555f-4a32-8ce8-cc331529247f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.730323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:55.733064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3960b5-e7d1-4059-930f-62cc6fd241c1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.733607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3960b5-e7d1-4059-930f-62cc6fd241c1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.734179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3960b5-e7d1-4059-930f-62cc6fd241c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.754216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ed3960b5-e7d1-4059-930f-62cc6fd241c1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:55.755406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ed3960b5-e7d1-4059-930f-62cc6fd241c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:55.767131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.767781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.768056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.768319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.779762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:55.783904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:55.784332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:55.785251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:55.786114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 368/735] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:55.786812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:55.834340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 368/736] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 08:25:55.839774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cf11f-13ae-4a87-8c1b-d11f7adbcd6f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.839774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cf11f-13ae-4a87-8c1b-d11f7adbcd6f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.839774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cf11f-13ae-4a87-8c1b-d11f7adbcd6f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.839774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 369/737] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:55.839774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cf11f-13ae-4a87-8c1b-d11f7adbcd6f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:55.911986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1c191-b6a6-4653-9f03-6ace08a97748 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.958832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:55.959845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.960262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:55.960670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:55.971640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:55.973093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cf11f-13ae-4a87-8c1b-d11f7adbcd6f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:55.973641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-536271ef-ad04-48c7-8ac8-a20de7c37e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:55.989386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:55.990570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:55.991688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:55.991688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:55.991688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:55.998112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 369/738] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:55.999520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89644-4a99-4486-a887-a61286794919 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:55.999966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89644-4a99-4486-a887-a61286794919 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.000391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f89644-4a99-4486-a887-a61286794919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.012460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.013064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.013337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.013604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.014314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:56.014616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.016439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.021503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-26f89644-4a99-4486-a887-a61286794919 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:56.022835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-26f89644-4a99-4486-a887-a61286794919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:56.025185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 370/739] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:56.026001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.034068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.057484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.096725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 370/740] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 08:25:56.097933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89644-4a99-4486-a887-a61286794919 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.143695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1518-5ced-4dfb-8d15-4dd1a242e805 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.178488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.179092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.179424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.179728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.180894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:56.181316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.182525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.199748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 371/741] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:56.199748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.215064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f89644-4a99-4486-a887-a61286794919 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.258896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.259825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.260245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.260650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.271239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.272854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.275568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:56.288824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:56.290140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:56.291040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:56.291040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:56.291040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:56.293146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 371/742] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:56.294213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.303591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.322305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc07c3-65d9-4881-81ea-bc2e17a12b3c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.357834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.358697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.359139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.359588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.370994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:25:56.375967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:56.377097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:25:56.378143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:56.380214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 372/743] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:56.381139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.398291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547245f7-3b38-4ca4-a081-57495bcced54 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.433856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.434477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.434749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.435013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.441675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.443093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:56.454474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:56.455692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:56.456783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:56.460298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 372/744] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:56.461324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.488236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e697b2-7578-421a-afe6-bf5d030b798e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.520401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.528409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.529015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.529295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.529565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.530362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:56.530665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.532188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.544590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 373/745] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:56.545448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.553413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.570050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856c19-9b62-4cfb-ab12-8ae5a88fd1ba None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.610911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.611511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.611816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.612079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.612711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.614062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.631825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 373/746] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:25:56 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:25:56.632663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.681476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bd8a0-f8b0-4ccf-908a-4299a9c2274c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.741202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.741884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.742168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.743153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.743950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:56.744322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.745814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.760070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 374/747] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:56.761078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.767579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544d59-7650-4c58-85f8-e16936e7cf8c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.789018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.817521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.818207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.818458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.818728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.819628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:56.820308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.822815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.838592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 374/748] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:56.839315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:56.854654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:56.880329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b4a1-93ec-4a34-94a6-054ea8f615fd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.927468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:56.928490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:56.928991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:56.929456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:56.938133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:56.939832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:56.951943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:56.952927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:25:56.953870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:56.961005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713c65-1497-4954-9952-68f68ebcf6cf None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:56.961402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 375/749] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:56.962460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.001324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.001971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.002228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.002499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.017510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.019482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:57.040277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:57.041307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:57.042267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:57.042267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:57.042267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:57.046511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 375/750] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:57.047502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.074270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd800bcd-3cd6-44ed-bb6d-36b5600bbed1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.087091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.100668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.119234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.120263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.120833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.121324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.122295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=5dccb9c74e7a45279ae6f5581a497a6d) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:57.122795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.124622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.131157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 376/751] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:56 2022] GET /identity/v3/role_assignments?user.id=5dccb9c74e7a45279ae6f5581a497a6d&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:57.132443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.182958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b94c-0d1c-47e1-9da1-333c4fc27c30 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.221537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.222951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.223446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.223949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.224928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:57.225463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.227726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.251890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 376/752] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:57.253557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.265663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecfc20-406d-47ae-84a5-52408090ab91 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.319534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.320624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.323402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.323991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.324952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:57.327115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.329872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.359092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 377/753] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:57.365611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.381384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.399072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f64-ba30-4fb5-a1e7-9970aefd79b5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.439561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.441307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.442353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.442839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.464535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.467648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.472860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ca4cdb0a-22ab-4e8f-8580-0170c0b448ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:57.493683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:57.494716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:57.495845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:57.495845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:57.495845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:57.495845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 377/754] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:57.500282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda931f8-8b03-4b48-aff3-eee35f74cc1c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.500565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda931f8-8b03-4b48-aff3-eee35f74cc1c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.500835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda931f8-8b03-4b48-aff3-eee35f74cc1c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.502316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 378/755] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:57.504096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda931f8-8b03-4b48-aff3-eee35f74cc1c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.545768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6804f-fc9c-4b4b-9cb0-207dc500e6b4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.581400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.581947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.582226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.582496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.591105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.592659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8d689a9b-729f-41dd-8261-0f68944c42db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:25:57.607307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:57.608344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 378/756] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.611162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.612840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.629020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:57.630305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:57.643262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda931f8-8b03-4b48-aff3-eee35f74cc1c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.688262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.688863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.689399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.689672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.690311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:57.690748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.692461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.701092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.711775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 379/758] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:25:57.712498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 379/758] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:57.713533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.713756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.769823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.819213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da3703-a190-4795-8c41-51fdfc9d752a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.854393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.855042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.855319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.855610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.862577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.867562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:57.875247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:57.876174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:57.877106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 380/759] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:57.884073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:57.892152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175d759-4388-4e9d-8052-df706a7b6e0b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:57.946719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:57.947730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:57.948212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:57.948706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:57.949657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:57.950158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:57.951920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:57.963935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:57.971260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 380/760] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:57.976466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.041618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df98590-3441-487b-92bb-7bea27ec7589 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.072705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.080327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e2559-8a1f-42de-b1d7-2216fcb1af8f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.112970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.113927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.114414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.115282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.116351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:58.116886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.118645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.134018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 381/761] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:58.135380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.145101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.145708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.145983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.146247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.235678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.238200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.254192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe8-c8a1-4158-a5f5-efd676715924 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.273995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.295377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.295760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.295947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.296215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.296796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.298217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:58.309462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:58.310488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:25:58.311344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:58.315351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 382/762] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:58.316211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.371067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.381310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 381/763] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:25:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:25:58.382411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.429510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeb15e-d7a5-4664-93ea-ae57227c42f1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.467532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.469042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.469042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.469042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.470924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=6e110ca44c21448c807e788a08126a99, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.472395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.490907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 383/764] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:25:58 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:25:58.492747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.504915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1892-4e88-4a9c-a0de-ecad44310f3f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.547738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.548465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.548803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.549146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.549952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:58.550390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.551962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.558596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.561714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 382/765] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:58.565340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.693516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28f4d-b35f-4b85-9360-8e78b3543b56 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.695821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.744241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.745654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.746404 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.746853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.754717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b012-89fb-4587-a10b-2cccb67ba004 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.763079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.765386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:25:58.788103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:58.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:25:58.790647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:25:58.790647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:25:58.790647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:58.793161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 384/766] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:58.799609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.814264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:58.815454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:58.815893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:58.816309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:58.817113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:58.817574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:58.819097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:58.828544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 383/767] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:58.836165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:58.965522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:58.973279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168d96-2e1c-47fc-ad57-4ac586d7ec3e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.973883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95430a-cba0-45ed-8d9a-f8ccb083bf88 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:58.998364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:59.009631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.010237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.010510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.010774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.011525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:59.011864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.012075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.012833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.013221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e33fd2-400e-4166-bfd0-a1f2ee0a5148 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.013430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.013847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.014683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] RBAC: Adding query filter params (interface=public, service_id=833a32e16f12473f95b5882a984345ae, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:59.015145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.016683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36727577-ba55-468a-ad44-49ddd36f71ed None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.028535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 384/768] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/endpoints?service_id=833a32e16f12473f95b5882a984345ae&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:25:59.028535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397293d-30e5-4b9e-800e-4f9425270f91 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.028535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397293d-30e5-4b9e-800e-4f9425270f91 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.028535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397293d-30e5-4b9e-800e-4f9425270f91 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.028535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 385/769] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:59.031578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397293d-30e5-4b9e-800e-4f9425270f91 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.035708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 385/770] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:59.037802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.038085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.038355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.059186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:59.060410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:59.144978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 386/771] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:25:59.145835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.158924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397293d-30e5-4b9e-800e-4f9425270f91 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.195675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.196286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.196571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.197262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.198004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.199769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce988012-aae1-4632-bfc5-97321749bc43 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.206684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 386/772] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:59.208163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e91c6-3939-4e5e-824d-5096d3aab0e2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.208445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e91c6-3939-4e5e-824d-5096d3aab0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.208722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e91c6-3939-4e5e-824d-5096d3aab0e2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.210141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 387/773] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:25:59.216744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.217354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.218144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.256300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:25:59.259340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:25:59.283909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:59.317676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:59.329774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d6b4-9832-45c6-b50b-490310279a99 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.345635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 388/774] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:25:59.388329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.388963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.389240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.389506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.399414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.401064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:25:59.416338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:59.417241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:25:59.418172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:59.422162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 387/775] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:25:59.423581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.453672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.581339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e42360-cf0a-4167-b4f1-44868278622e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.599692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4766153-58ad-428a-adff-db24c4e9ac8e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.646309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.646933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.647243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.647558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.648291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:59.649245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.650706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.663713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.664383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.664655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.664922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.665499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.667133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.672239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 389/776] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:25:59.681358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:25:59.683648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:25:59.685669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 388/777] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:25:59.687590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.691304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.705630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:59.733763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:25:59.800901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e4f0e-dffd-4c62-8ef6-3d2ef1e9d0f6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.826636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc328-7c4b-43c2-b79f-3164af7c2fb6 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:25:59.849469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.849992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.850272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.850541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.851684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=a87ac9986eb54e468cc292bcecbeeb90) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:59.851994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.853826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.863115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 390/778] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/role_assignments?user.id=a87ac9986eb54e468cc292bcecbeeb90&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:59.869315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:25:59.875744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:25:59.876864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:25:59.877347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:25:59.877821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:25:59.879224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] RBAC: Adding query filter params (name=network) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:25:59.885311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:25:59.887176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:25:59.895132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 389/779] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:25:59.901585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.033135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.065421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b856-7672-46c1-920d-b8000ebfffd8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.067948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.078090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4089-1a3c-46e3-8f66-acc89e021472 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.113494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.114473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.114944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.115409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.115525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.116082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.116364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.116643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.118023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] RBAC: Adding query filter params (type=network) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:00.118344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.119746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.128834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 390/780] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:00.134885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.138380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:00.149887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:00.150822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:00.152072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:00.154439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 391/781] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:00.160506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.347234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea449-6c42-4414-aa01-1eb8c199402b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.356774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc03a6-27de-4f74-9bba-996fcd61fb0c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.420989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.423509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.424021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.424942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.427909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] RBAC: Adding query filter params (interface=public, service_id=24ccd5aef54a43f8976a0e7cb24c9ee4, region_id=RegionOne) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:00.428435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.430949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.432191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.433012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.435148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.435649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.436513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:00.437012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.438790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.443732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.447869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 391/782] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/endpoints?service_id=24ccd5aef54a43f8976a0e7cb24c9ee4&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:00.457880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.458358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 392/783] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:00.459797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.502615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.564596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395efd-f640-4793-93e0-c83a8b936e2d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.633413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.634024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.634302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.634575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.635185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.636587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c09d-542c-40cb-b5ee-f70293f1ce46 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.641348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25651f-4f5b-4191-bf37-024433fbc001 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.652796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 392/784] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:00.689190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b6ab-777c-4545-ab14-83b20d8b6476 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.689476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b6ab-777c-4545-ab14-83b20d8b6476 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.689663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b6ab-777c-4545-ab14-83b20d8b6476 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.691017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 393/785] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:00.696664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456725-231d-4393-84b3-7aba83748242 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.697012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456725-231d-4393-84b3-7aba83748242 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.697216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456725-231d-4393-84b3-7aba83748242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.707234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.707926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.708203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.708475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.729501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2e456725-231d-4393-84b3-7aba83748242 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:00.731384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2e456725-231d-4393-84b3-7aba83748242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:00.732492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.734235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:00.766583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:00.767627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:00.768532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:00.768532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:00.768532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:00.776934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 393/786] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:00.793002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:00.857511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.869177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 394/787] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:00.910126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:00.932251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17187710-c6b6-4e0d-a3a2-e4771b37ae53 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:00.967450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:00.968004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:00.968277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:00.968549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:00.969186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:00.969484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:00.970852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:00.984735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 394/788] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:00.989932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456725-231d-4393-84b3-7aba83748242 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.130518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456725-231d-4393-84b3-7aba83748242 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.166128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.166756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.167035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.167302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.174537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:01.176011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:01.188169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:01.189160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:01.190139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 395/789] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:01.195124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.239044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.354585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:01.423126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17389841-0734-48e2-839e-9c4d61a079b1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.469374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.470121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.470490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.470830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.484705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-b891e33b-a1b9-46fd-a284-e238da056585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:01.491894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:01.493351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:01.494206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:01.499341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 396/790] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:01.501052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121bf0-5964-44af-85f3-25c504955c72 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.501609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121bf0-5964-44af-85f3-25c504955c72 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.501886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121bf0-5964-44af-85f3-25c504955c72 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.503400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 397/791] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:01.503516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d3ee-955c-4c01-9246-f48bdbe0fc74 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.504131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121bf0-5964-44af-85f3-25c504955c72 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.552497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.553561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.553839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.554110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.555892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:01.556480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:01.558164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55727580-24d8-48d0-a8b6-fedacb05a3e7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:01.569571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:01.584174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 395/792] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:26:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:01.585950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.587244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.587716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.610663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:01.612123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:01.624488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121bf0-5964-44af-85f3-25c504955c72 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.640961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:01.664774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.665716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.666132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.666545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.668134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:01.668134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:01.669653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:01.678872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 398/793] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:01.680357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.709986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 396/794] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:01.715579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:01.888469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158286f-41e1-4658-b5c1-c5b231d8a25e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.927145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e0f8-b94f-4e8e-809d-70652fd8bd1c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:01.951693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.952332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.952608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.952876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.980212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:01.984432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:01.984665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:01.985132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:01.985405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:01.985911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:01.986603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:01.999056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.001012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:02.019041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:02.020118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:02.021004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:02.021004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:02.021004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:02.021183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:02.022026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:02.023419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:02.023419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:02.023419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:02.023419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 399/795] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:02.023419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.025624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 397/796] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:02.035932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.064604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.144584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67d083-e6a7-4383-9959-22dc6917dc62 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.181072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4e5e-e338-4a93-befa-385024209466 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.185066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.185959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.186505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.186967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.187767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.189825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:02.202180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:02.203168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 08:26:02.204079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:02.205712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 400/797] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:02.206375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.219137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.220084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.220084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.220351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.220929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.221228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.222870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.233973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 398/798] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:02.239071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.286902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.322194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.333923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b02ac-b011-443c-a112-73cdb3a89b7c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.355423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e326-340d-4658-bf25-63bb8ef735a3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.376004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.377140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.377707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.378056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.378787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.379154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.380686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7b99e-7119-4674-b507-d336e43228de None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.390983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.391697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.392042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.392381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.393075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.393442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.398651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 401/799] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:02.398805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.398900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127967c-e101-4f8f-839b-e87908ba90d2 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.398900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127967c-e101-4f8f-839b-e87908ba90d2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.398900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127967c-e101-4f8f-839b-e87908ba90d2 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.403633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 402/800] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:02.404480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127967c-e101-4f8f-839b-e87908ba90d2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.407914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 399/801] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:02.408755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.516272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c8db-d823-4ead-b289-71ded018fc1a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.517888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.523269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127967c-e101-4f8f-839b-e87908ba90d2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.555894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.556519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.556794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.557062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.559586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.560241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.560516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.560784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.564068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.565502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.568398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.569870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ef0ca39b-ed91-4afd-9374-9a42695be7f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:02.577213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:02.578084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:02.578998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 400/802] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:02.579483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.580590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.580590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:02.582336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:02.583242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:02.584238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:02.589896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 403/803] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:02.589896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.606205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:02.607412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:02.609073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.676803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 401/804] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:02.677557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.710769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400460a-30ff-461d-b6a5-08d53ef12acb None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.756561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.757168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.757445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.757714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.758369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.758672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.760717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.771467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 404/805] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:02.771467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.792092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.802977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2378524-ddfa-4605-a66b-34717ae45b95 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.838957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.839855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.840274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.840698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.841535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.841991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.843784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.856924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 402/806] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:02.858120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.864543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:02.890847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672858c-8719-4de1-886f-458dd07f6fb2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.927726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.928742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.929012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.929280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.930028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:02.930326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.931776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:02.954495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 405/807] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:26:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:02.955729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:02.957979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15b87-e021-439c-9da5-d9e76ec879df None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:02.991943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:02.992569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:02.992848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:02.993120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:02.993770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:02.995126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c93b4-db59-4f7d-a1ad-7c77da8d2e99 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.015948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 403/808] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:03.017223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf165bb-4353-4d4a-b9ff-1d923d04fb08 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.017505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf165bb-4353-4d4a-b9ff-1d923d04fb08 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.017773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf165bb-4353-4d4a-b9ff-1d923d04fb08 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.018958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 404/809] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:03.019676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf165bb-4353-4d4a-b9ff-1d923d04fb08 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.038234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.073111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37411ba8-c06d-40c0-a995-f6641b68ab2d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.117933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.124983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.126023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.126306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.126701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/5dccb9c74e7a45279ae6f5581a497a6d/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.128634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=5dccb9c74e7a45279ae6f5581a497a6d, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.130186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.145131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 406/810] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:02 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/5dccb9c74e7a45279ae6f5581a497a6d/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:26:03.146236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.164750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf165bb-4353-4d4a-b9ff-1d923d04fb08 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.212600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.214134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.214608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.214956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.278136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c9f88-fb77-4721-a12a-a3956bdcab93 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.310536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.312314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.319643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.321029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.321450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.321862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.326559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.337986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-fb39c8bb-03eb-42a5-a203-058b24d4c9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:03.344950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:03.345920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:03.346792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 407/811] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:03.348588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.348873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.349142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.371163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:03.372879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:03.420572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 405/812] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:03.421438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.432185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.458929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 408/813] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:03.460066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.605084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f4d0e-d69a-4b56-9c2b-c05dddbb0c89 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.621159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.644589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97f125-80fc-48df-94c4-3e9a1693de1f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.655865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.656757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.657261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.657754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.658628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:03.659126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.660728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.669517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 406/814] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:03.675120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.707600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.707600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.707600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.707600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.724572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.726029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:03.756716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:03.757806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:03.759243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:03.759243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:03.759243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:03.762460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 409/815] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:03.764643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.805720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.816229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9d80-8c6c-4a85-b458-6a41d15f9dda None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.854657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.855786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.856085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.856598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.870740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.872220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:03.886841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:03.887839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:03.888770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:03.888770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:03.888770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:03.888770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 407/816] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:03.889404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.900241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b46848-c42a-4d00-a8d3-92632629df7e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:03.915514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:03.948878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:03.949933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:03.950797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:03.951465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:03.952304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:03.953003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:03.955515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:03.971499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 410/817] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:03.972507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:03.998924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507dea-a687-4ac7-a685-0ef7821b614b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.034150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.034862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.035239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.035754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] PATH_INFO: `/v3/services/network` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.036375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.037882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:04.048109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:04.049331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 08:26:04.050249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:04.051025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 408/818] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:04.057081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.096563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.108764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240062-d4cf-4cbd-8e9d-71d023af7d72 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.162449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.163330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.163648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.163925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.165202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.165512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.167355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.168579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.185359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 411/819] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.186384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.187635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2df8-3ace-427e-a877-bd07367f8d84 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.239371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.240918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.241203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.241477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.249669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.251635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:04.266798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:04.267780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:04.268673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:04.271674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 409/820] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:04.274191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.329041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434780-7b69-4d8e-b4dd-dffbeab6b846 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.376900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.378256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.379136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.379798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.380724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] RBAC: Adding query filter params (name=network) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.381503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.383864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.390091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 412/821] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.391474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.403228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092091f8-643a-4095-80ac-0d63dc9fb065 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.416187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.445410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.446442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.446724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.446999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.456979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.459277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:04.475041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:04.476247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:04.478162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:04.481558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 410/822] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:04.482271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.491651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.527290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f82e-bd27-44e3-964a-f3c7ffb8ee8b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.568939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.569677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.569858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.570080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.571372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.571623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.573046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.589077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 413/823] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.590694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.628419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3f1b1-bbf9-4df2-a321-a26403b8bf5f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.669577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.670055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.670334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.670607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.671234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.671534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.672911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.678172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 411/824] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.679025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.685003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.717289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae45a-4d1c-4180-b4e1-37ee3eb44a9a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.753383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:04.761607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.762356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.763271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.763738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.764727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.765150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.767038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.792903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 414/825] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.794054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.796378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d519-df4b-4006-afe2-01d6c01cbec7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:04.840462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:04.841574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:04.841950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:04.842336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:04.843461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:04.843892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:04.845760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:04.859570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 412/826] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:04.859570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:04.981064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334e9e-7acc-4f9d-bf5a-fb1c88309135 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.010312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5c9f-0bcf-4d6f-a00a-d3c60a2882e7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.021320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.021985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.022376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.022644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.025677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.035996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.037912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:05.057833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:05.058853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:05.059821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:05.059821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:05.059821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:05.059821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 413/827] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:05.066071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.066312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.066684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.066965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.067237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.068012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.069697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676af6c-ad00-4057-99e6-f37104c16a18 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.083775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.102316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 415/828] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:05.103716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285116-023d-4d05-ad6f-2a43ec3a3ce8 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.103844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285116-023d-4d05-ad6f-2a43ec3a3ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.104161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285116-023d-4d05-ad6f-2a43ec3a3ce8 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.105597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 416/829] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:05.111170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-7b3d-4790-b86e-683a21f1bcb9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.111576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-7b3d-4790-b86e-683a21f1bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.111787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-7b3d-4790-b86e-683a21f1bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.138726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9960e6e8-7b3d-4790-b86e-683a21f1bcb9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:05.140080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9960e6e8-7b3d-4790-b86e-683a21f1bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:05.204025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329910d4-a5c1-43b8-a228-fb074e44d23d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.267894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 417/830] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:05.273777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.274769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.275253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.275796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.276677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:05.277284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.278906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.293557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 414/831] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:05.297747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6a34-dbb3-4746-a71e-5d4f94f8528d None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.298255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6a34-dbb3-4746-a71e-5d4f94f8528d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.298815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.298927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6a34-dbb3-4746-a71e-5d4f94f8528d None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.304410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 418/832] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:05.306236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.306522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.306789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.326641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:05.327872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:05.363073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.417594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 419/833] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:05.432887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c9ed9-c82b-4cad-81de-6001355dc14a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.468696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.469265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.469542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.469806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.477289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.478711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:05.489896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:05.490803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:05.491773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 415/834] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:05.497765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.548760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.569413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.621135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc45de4-02bd-4cbd-84bd-b6e10fc58737 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.668196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.669067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.669367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.670089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.671067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:05.671379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.673460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.689990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 420/835] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:05.691950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0a8c-b5b2-48d3-b2e3-0c4ed2122ef6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.695959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.700882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.731139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.731955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.732303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.732642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.733317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.734735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:05.743924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:05.744981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:05.745856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 416/836] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:05.751511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.814244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7118cc-5a9f-4691-bc16-25ef450edc39 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.822058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:05.856668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70beca-eca3-493a-a8c9-c1797bb49d87 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:05.857532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.858445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.859503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.859832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/a87ac9986eb54e468cc292bcecbeeb90/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.878164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=a87ac9986eb54e468cc292bcecbeeb90, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.879611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.892218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:05.892727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 421/837] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:05 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/a87ac9986eb54e468cc292bcecbeeb90/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:26:05.892840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:05.893089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:05.893364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:05.893986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:05.894289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:05.895695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:05.906218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 417/838] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:05.906431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.907245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:05.962682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:06.021672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b367-2298-4b64-9237-86a8007bf63a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.043012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65153-758d-4e45-9a90-3b02d587ec82 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.064978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.065544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.065819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.066087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.079483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:06.084644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:06.085613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:06.086510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 422/839] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:06.091851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.093361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.094197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.094638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.095184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.096123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:06.096614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.098119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.105493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 418/840] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:06.119756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:06.216747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183bdf3-0e1b-411a-b21b-32646b8056c3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.256365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.257860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.257860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.257860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.258219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:06.258544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.259981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.269165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 423/841] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:06.274618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.379890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86695006-30ab-4e77-abe2-0016cfa2224a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.383922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:06.417263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.417898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.418178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.418449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.428896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.430908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:06.446120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:06.447112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:06.448052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:06.448052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:06.448052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:06.448052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 419/842] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:06.453308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.537808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:06.562127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa338-c8cc-4c60-b32c-d511827ca243 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.597976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.598946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.599418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.599957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.600841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:06.601336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.603520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.616627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 424/843] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:06.625046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.725613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbdf08-8900-454c-ba6f-1e32805cea9e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.759284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.759941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.760215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.760482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.767863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.769278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:06.780961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:06.781920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:06.782881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 420/844] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:06.788030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.891530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6018da-cdf8-4357-9c3e-217800256d5a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:06.927104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:06.927733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:06.928007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:06.928273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:06.928991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:06.929293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:06.930747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830fd03-1132-4992-8050-d347a05e3340 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:06.939888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:06.949455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 425/845] 10.222.0.15 () {56 vars in 1135 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:06.955128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:06.980471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.043327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5700-c76d-4f40-a988-315527241f71 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.043686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5700-c76d-4f40-a988-315527241f71 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.043897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5700-c76d-4f40-a988-315527241f71 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.045530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 426/846] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:07.054857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.055136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.055407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.064971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb260d-d48b-4f90-97ae-0bd1a415ad2f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.074449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:07.075655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:07.110808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.111432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.111729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.111997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.169603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 427/847] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:07.190589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.192129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.204406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.293881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 421/848] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:07.299518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.406694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8d274-5823-466d-99bd-dae24e6485bc None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.436143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.442890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.443711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.444211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.444480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.446786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.457686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.459210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:07.474210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:07.475199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:07.476162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:07.476162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:07.476162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:07.476162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 428/849] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:07.481250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.560958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ae1d0-a60f-4525-9a94-0fa3a16a68a0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.574026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.588808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d8a7-923f-4510-ad86-cb97ca43c4a9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.611792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.612787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.613888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.614322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.615381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.618092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.626493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.627219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.627628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.628008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.628756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:07.629157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:07.630071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:07.631192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:07.632409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:07.633533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.635284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 422/850] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:07.643052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.650148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 429/851] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:07.656034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.699223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.764347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe953-d5c9-4a5a-86d5-0895b83037e0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.765086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504ee2-e774-4db6-9e37-2696473843db None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.800188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.801250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.801789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.802254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.803064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:07.803654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.804136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.805447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.805829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.806169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.806547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.816085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.816085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.816307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 423/852] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:07.817679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:07.829562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:07.830770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:07.831708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:07.835701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 430/853] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:07.837231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:07.865339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.931688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596d2a1-d400-4a25-bc60-564d3f0c0b61 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.943723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:07.947885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad47-7bbf-4ee8-8284-f944d182ee16 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:07.966588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.967203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.967482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.967782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.968411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:07.968712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:07.970073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961467-4ac1-484d-bedd-5e13cee45408 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:07.974604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 424/854] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:07.975675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc199ea-8566-4529-ab38-8da31f222e52 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.975956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc199ea-8566-4529-ab38-8da31f222e52 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.976224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc199ea-8566-4529-ab38-8da31f222e52 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.978143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 425/855] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:07.983691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cbdc-2a1c-43de-a9f7-ca8662e46276 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.983986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cbdc-2a1c-43de-a9f7-ca8662e46276 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.984266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cbdc-2a1c-43de-a9f7-ca8662e46276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:07.998293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:07.998991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:07.999273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:07.999561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.000347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:08.000656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:08.002240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:08.008330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-55c0cbdc-2a1c-43de-a9f7-ca8662e46276 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:08.009855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-55c0cbdc-2a1c-43de-a9f7-ca8662e46276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:08.021963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 431/856] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:08.022975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.114436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 426/857] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:08.145665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94963df3-e470-4a69-9103-4c20310c865f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:08.160207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40b9-1c7d-4727-bf37-dedd14276525 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.160490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40b9-1c7d-4727-bf37-dedd14276525 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.160764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40b9-1c7d-4727-bf37-dedd14276525 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.163330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 427/858] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:08.167959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.168234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.168499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.184230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:08.184977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.185257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.185658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.186384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=5dccb9c74e7a45279ae6f5581a497a6d) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:08.186686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:08.188199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:08.189098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:08.190290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:08.195785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 432/859] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:08 2022] GET /identity/v3/role_assignments?user.id=5dccb9c74e7a45279ae6f5581a497a6d&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:08.221485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:08.269663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 428/860] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:08.391951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.418224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:08.497777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1600-6d13-41e3-b1a5-45a3abdd0ccd None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:08.532617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:08.533363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.533644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.533913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.543892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.545322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:08.550534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:08.551482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:08.552391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 433/861] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:08.558141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.653917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:08.673915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba06fb-d6c8-4f75-a3ae-97f76ec39650 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:08.688650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ac3a-31eb-4ce8-8e69-83aaf657185b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:08.716746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:08.718265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.718763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.719211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.720748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:08.721352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:08.723289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:08.728949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:08.729652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.729994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.730331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.731220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:08.732546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:08.734465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 434/862] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:26:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:08.739968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.753710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 429/863] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:08 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:26:08.865918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249ea1-f8ea-4624-9e9a-caa9588e3169 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:08.910967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6785-3687-4680-949c-49b551051528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:08.911531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6785-3687-4680-949c-49b551051528 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:08.911853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6785-3687-4680-949c-49b551051528 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:08.912127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6785-3687-4680-949c-49b551051528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:08.922641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:08.926174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6785-3687-4680-949c-49b551051528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:08.926631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6785-3687-4680-949c-49b551051528 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-cbce6785-3687-4680-949c-49b551051528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:08.943511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:08.944518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:08.945468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:08.945468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:08.945468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:08.948074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 435/864] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:08.951919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:08.984308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:09.058978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59147a6-0ad2-4a38-8bd4-c7201efc22aa None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:09.095381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:09.096023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:09.096300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:09.096569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:09.097210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:09.097509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:09.098863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:09.111905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 430/865] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:09.117661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6785-3687-4680-949c-49b551051528 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:09.227170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6785-3687-4680-949c-49b551051528 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:09.261999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:09.262628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:09.262901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:09.263171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:09.271123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:09.272593 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:09.285443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:09.286425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:09.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 436/866] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:26:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:09.294199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:09.399703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:09.401922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e67fc-0470-4c3b-8c14-c588632795c8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:09.436858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:09.437455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:09.437729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:09.437994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:09.438708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:09.439006 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:09.440443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:09.459238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 431/867] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:26:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:09.468597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:09.526698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:09.576043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687a4a-19af-4aea-b123-182c70c23f68 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:09.617695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:09.618309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:09.618583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:09.618849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:09.694839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:09.696887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:09.750635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:09.799801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 437/868] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:09 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:09.805870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:09.909153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17995e-2fba-411e-9318-27ef3ded4173 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:09.946614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:09.947244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:09.947516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:09.947813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:09.958243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:09.959716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:09.961689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-c5ba453f-0986-44de-9927-2af998afa194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:09.974846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:09.976916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:09.977847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:09.977847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:09.977847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:09.977847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 432/869] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:09.982645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.053383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717722b9-dcbb-4a6c-9b3b-13d9109d1267 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.053683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717722b9-dcbb-4a6c-9b3b-13d9109d1267 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.053897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717722b9-dcbb-4a6c-9b3b-13d9109d1267 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.056331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 433/870] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:10.067852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd530c-d369-4d55-b58c-d241f9f44ccd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.068625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd530c-d369-4d55-b58c-d241f9f44ccd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.069027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd530c-d369-4d55-b58c-d241f9f44ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.092763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108f56-965e-4f72-8182-8eefd4754cf9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.093374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3abd530c-d369-4d55-b58c-d241f9f44ccd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:10.094911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3abd530c-d369-4d55-b58c-d241f9f44ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:10.133165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.134062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.134520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.134990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.135824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:10.136296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.137799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.150821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 438/871] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:10.156673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.176969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:10.183619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 434/872] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:10.214937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f17fd-93da-440f-bd80-aafeb4e66022 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.215557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f17fd-93da-440f-bd80-aafeb4e66022 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.216034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f17fd-93da-440f-bd80-aafeb4e66022 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.217828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 435/873] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:10.224631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.225146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.225719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.245073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:10.246697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:10.274887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296942c-012c-4b88-bf3b-8942de7674fa None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.317577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.323617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.323617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.323617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.324287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 436/874] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:10.325764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.327393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:10.340248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:10.341164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:10.342151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 439/875] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:10.347334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.407171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:10.464771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220a70-a1e8-408b-8680-7942467a5cdc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.471494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.501402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.502003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.502275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.502539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.503220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:10.503637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.505137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.517978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 437/876] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:10.524551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.547972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:10.582997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826430-c9ab-441b-93e4-05bd8eb3c923 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.627041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.627693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.627988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.628257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.628918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.630271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.647465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a947d1-712d-47cb-92b2-ad619eb2f5c0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.650353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 440/877] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:10 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:26:10.651341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.664068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:10.695909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.696677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.697053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.697439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.698301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=a87ac9986eb54e468cc292bcecbeeb90) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:10.698878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.700317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a836d0-5efa-423f-b1e9-ea6b819ea8b9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.715585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 438/878] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:10 2022] GET /identity/v3/role_assignments?user.id=a87ac9986eb54e468cc292bcecbeeb90&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:10.773098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e787-dc3a-42e0-9d0a-87fcddc35813 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.774018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e787-dc3a-42e0-9d0a-87fcddc35813 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.774211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e787-dc3a-42e0-9d0a-87fcddc35813 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.775914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 439/879] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:10.781991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.782316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.782532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.806994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:10.808875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:10.812093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd308285-afb6-4900-93d7-cd45340a43cd None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:10.852937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:10.860520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:10.861241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:10.861783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:10.862289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:10.863139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:10.864589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:10.876804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:10.878112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:10.879161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 441/880] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:10.890850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:10.907720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 440/881] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:11.000880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95861a49-fc71-4e4b-a405-5f51bda56a6f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.038609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.039629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.040105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.040610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.041431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:11.041951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.043659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.049068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 442/882] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:11.059607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.158397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e166-d54e-44dc-950c-ed0261a5eb42 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.159901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:11.174306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.204624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.206023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.206825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.207386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.208281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:11.208959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.211288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.224201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 441/883] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:11.247263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:11.294083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d63b9-756e-4cbb-9fdb-3f158efbb72b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.333053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.333699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.333974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.334246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.334833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.336277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:11.346063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:11.347133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:11.348599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 443/884] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:11.354168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.458462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22b0a1-c00d-4e1c-83ec-39e79caf4940 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.493523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.494172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.494445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.494744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.495373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:11.495693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.497038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.501947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 442/885] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:11.507592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.620019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea4c3d-3741-426d-94e9-29b6cd553188 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.644644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:11.656669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.657274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.657546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.657814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.658446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:11.658741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.660132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.665957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 444/886] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:11.671482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.702814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:11.782743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0160d7e-dc93-4fbf-aed4-96114295fc48 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.820882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.821743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.822188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.822599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.823435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] RBAC: Adding query filter params (interface=public, service_id=07b45a328d484dccb2d2d0aa016e5ea0, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:11.823913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.825413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99225d-d024-435a-bb99-11922c9c86e0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.831303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 443/887] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/endpoints?service_id=07b45a328d484dccb2d2d0aa016e5ea0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:11.836954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:11.939651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2fd69-225b-40ab-acfd-753648db5bd2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:11.975217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:11.975902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:11.976174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:11.976469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:11.977071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:11.978427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84a87-8665-4ef6-bbcc-b3887c8e79ba None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:11.984403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 445/888] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:11 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:26:12.631817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ded7-6cc0-4f56-8b5e-6be30d53fe2c None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:12.632313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ded7-6cc0-4f56-8b5e-6be30d53fe2c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:12.632392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ded7-6cc0-4f56-8b5e-6be30d53fe2c None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:12.634002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 444/889] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:12.639141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cfa76-1d1b-443d-8d68-1ba74c2e25cd None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:12.639424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cfa76-1d1b-443d-8d68-1ba74c2e25cd None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:12.639733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cfa76-1d1b-443d-8d68-1ba74c2e25cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:12.658636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-880cfa76-1d1b-443d-8d68-1ba74c2e25cd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:12.659853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-880cfa76-1d1b-443d-8d68-1ba74c2e25cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:12.708468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:12.730288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 446/890] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:12.881080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472613-14c7-4969-ad64-40b0e15230b7 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:12.881436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472613-14c7-4969-ad64-40b0e15230b7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:12.881929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472613-14c7-4969-ad64-40b0e15230b7 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:12.884338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 445/891] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:12.889780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:12.890649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:12.891115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:12.910379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:12.911892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:12.987645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 447/892] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:12.997150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66472613-14c7-4969-ad64-40b0e15230b7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.104417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.106426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66472613-14c7-4969-ad64-40b0e15230b7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.142768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.143357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.143661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.143926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.144503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.145847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6c672e6b-4056-4bf3-97ab-b087e204fdda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:13.155327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:13.156299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:13.157526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 446/893] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 17 08:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:13.162466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.269955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9b9f1-0c99-4295-b002-b70e87aa7469 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.278291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50f75-3f70-401d-aaeb-ee8559c98f66 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.278445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50f75-3f70-401d-aaeb-ee8559c98f66 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.278627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50f75-3f70-401d-aaeb-ee8559c98f66 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.279959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 447/894] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:13.280643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d50f75-3f70-401d-aaeb-ee8559c98f66 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.285400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.309422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.310024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.310300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.310566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.311189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:13.311485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.312868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880adf5-5789-406f-ac2a-bc34ce84581d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.322437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 448/895] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:13.322437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.322437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.322437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.337790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:13.338963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:13.397206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d50f75-3f70-401d-aaeb-ee8559c98f66 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.411938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 449/896] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:13.411938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.438595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.439219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.439490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.439863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.453449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:13.458780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:13.459946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:13.460854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 448/897] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:13.465955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.487101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.539482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff143f-2a41-477f-8d39-8a081d726d9f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.549138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.583428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.584681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.585149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.585563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.586366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:13.586818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.589133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.604376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 450/898] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:13.607850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.618899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdac175-8e68-4d6d-bbef-4607e3550f1e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.665200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.666965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.667447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.667944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.669325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:13.669837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.671957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.683997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 449/899] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:13.685031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.721540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dd18e-29d7-45df-9f95-c4160d889c08 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.755939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.756540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.756813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.757078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.757796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] RBAC: Adding query filter params (interface=public, service_id=6b68c827511e4053bcb5667c94386323, region_id=RegionOne) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:13.758098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.759451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.764382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 451/900] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/endpoints?service_id=6b68c827511e4053bcb5667c94386323&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:13.765143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.783227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.805601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc6d7a-f948-4c37-b91d-3b83f855e005 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.809179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:13.845491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.846331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.846738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.847148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.847962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.849310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.865478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 450/901] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:13 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:13.866184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:13.888937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019978d-8762-4a4b-baf6-678d8195f9bb None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:13.942621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:13.943274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.943523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.943759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.955888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:13.957410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-dc68aed4-b699-46d9-9cd9-36c6cb5b61a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:13.973809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:13.974920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 452/902] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473841c-092d-448c-9644-9201879a38d2 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473841c-092d-448c-9644-9201879a38d2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473841c-092d-448c-9644-9201879a38d2 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:13.981932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 453/903] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:13.984587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:13.984869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:13.985141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.003689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:14.004913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:14.010477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36179a3-4f04-44b7-b146-125fdf1b19ab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.051034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.051667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.051941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.052216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.052819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.054176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.060405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 451/904] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:13 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:26:14.061216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.068883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.085390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 454/905] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:14.178584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7d1d9-becd-4b8b-83b4-530f2c659b49 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.218725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.219262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.219556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.219840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.220501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:14.220801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.222181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.235574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 452/906] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:14.241335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.257424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.352925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.353153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a4a8-15f0-4a1b-b8b7-a1169c3a1ddc None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.395366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.396044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.396326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.396599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.406546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.408052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:14.424472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:14.425469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:14.426431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:14.430746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 455/907] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:14.432351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.439078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.489749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f3c8b-b03c-42f2-92e0-df4cc0dc5f46 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.530189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.537607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.538544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.539652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.540105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.541275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.543418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:14.555732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:14.556772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 08:26:14.557663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:14.564829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 453/908] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:14.565858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.574307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831460-8f02-46c4-99f2-e46a08ca347d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.630747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.631923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.632390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.633360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.634510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:14.635425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.637452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.662459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 456/909] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:14.668433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.698081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a9e2-c526-4b01-815d-7585b6ac75f8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.727192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.736547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.737468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.737951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.738445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.739263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:14.739847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.741412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.748882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 454/910] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:14.754239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:14.798035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403f35-c1fd-4714-8f1f-dea84de20e4e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.830962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:14.838390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.838877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.839256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.839669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.889853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0a3c-f5b7-4ce5-957e-69303b26b530 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:14.920739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.922182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.940626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:14.941759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:14.942192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:14.942565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:14.943342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:14.943782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:14.946599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:14.954015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 455/911] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:14.959493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.023037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:15.055644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 457/912] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 08:26:15.060932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.082547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7324268-3bc1-4cce-90ef-c34be81b67b1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.096122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:15.141934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.143705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.144167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.144630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.145443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.147011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.183573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 456/913] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:15.183794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945494c-8eba-4de5-8fed-17afb9be900c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.231087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.231775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.232055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.232394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.245535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.247087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:15.268692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:15.269722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:15.270679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:15.270679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:15.270679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:15.276446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 458/914] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:15.280669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.396032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7b8e-5187-4408-9175-636f1640187d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.410798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:15.436507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.437263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.437640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.438015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.438757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:15.439160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.440657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.458483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 457/915] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:15.459951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.546816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:15.571307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f941-6b99-4e08-9390-f5eba6b3c46a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.610121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.610926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.611307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.611711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.619134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.620878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:15.633770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:15.634936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:15.636122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:15.642299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 459/916] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:15.643656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.748778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820c6a-cc95-4c8b-917f-55d8ac112116 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.791529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.792464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.792955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.793385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.794214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:15.794660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.796335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680ebc1-20ca-472b-951b-b6674cb28d23 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.812801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 458/917] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:15.814953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:15.868372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560135-6d8d-49b3-92ae-74bef900b46b None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.868655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560135-6d8d-49b3-92ae-74bef900b46b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.868933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560135-6d8d-49b3-92ae-74bef900b46b None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.870503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 459/918] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:15.875267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cfc84-b223-47d3-9f4b-d19b0a65ecf5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.875563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cfc84-b223-47d3-9f4b-d19b0a65ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.875840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cfc84-b223-47d3-9f4b-d19b0a65ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.894288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a15cfc84-b223-47d3-9f4b-d19b0a65ecf5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:15.895526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a15cfc84-b223-47d3-9f4b-d19b0a65ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:15.928745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:15.932916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306d7a-03ec-4a8c-b87f-d9d8ab1d7f6e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:15.970232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:15.970847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:15.971124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:15.971393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:15.972163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] RBAC: Adding query filter params (role.id=631d55b7080449738c732c362c40e446, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=a87ac9986eb54e468cc292bcecbeeb90) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:15.972470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:15.973875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d276b-88fd-4f4f-9c81-667e4bdda60e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:15.987576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 460/919] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:15 2022] GET /identity/v3/role_assignments?user.id=a87ac9986eb54e468cc292bcecbeeb90&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=631d55b7080449738c732c362c40e446 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:15.995768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 460/920] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:16.081437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ba48-1cc9-455e-8c46-7fc63f2406e2 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.081939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ba48-1cc9-455e-8c46-7fc63f2406e2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.081939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ba48-1cc9-455e-8c46-7fc63f2406e2 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.083571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 461/921] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:16.089748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.090309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.090785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.110416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:16.112198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:16.185906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 461/922] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:16.269438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ba48-1cc9-455e-8c46-7fc63f2406e2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.272728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:16.384700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ba48-1cc9-455e-8c46-7fc63f2406e2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.420520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.421166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.421444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.421716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.422316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.423738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:16.434760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:16.435855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.436698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 462/923] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:16.442005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.459742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.545516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:16.547142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:16.560292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c93c1-41d1-4f03-8b63-aef8b744f1c3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.595752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfeafcf-7758-40ed-8804-c116ad729587 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.609975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.610823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.611294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.611922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.612868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:16.613360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.615080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.621746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 462/924] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:16.631586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.639478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.640187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.640529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.640866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.641516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.642943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:16.652529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:16.653502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 08:26:16.654430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:16.658814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 463/925] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:16.659744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.765188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eea66-951a-4b78-a437-159b6e228fe9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.771641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8b8e2-a027-4f06-a72d-d48ae6ae407d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.806043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:16.814527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.815224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.815500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.815792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.816413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:16.816710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.818060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.820332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.821074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.821182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.821446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.822068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:16.822363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.823738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.830714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 463/926] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:16.831422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.835179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 464/927] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:16.840800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:16.860578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:16.951655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198fa36-7bf2-4543-8e40-ef0c6a504ade None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.969939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d42-6e62-48ee-af8c-cd9ed52ae5a9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:16.990124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:16.990636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:16.990918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:16.991193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:16.992245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:16.992356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:16.993677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:16.999092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 465/928] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:17.005080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:17.017208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:17.017854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.018130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.018398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.019105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] RBAC: Adding query filter params (interface=public, service_id=f0082d6e238541dab0f8e5464a258265, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:17.019417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:17.021288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:17.033760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 464/929] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:16 2022] GET /identity/v3/endpoints?service_id=f0082d6e238541dab0f8e5464a258265&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:17.034662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:17.090601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:17.148777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:17.151607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68571023-b9bc-4e08-92b3-79b4f0b3d3a3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:17.169300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894d79-932e-4646-90b3-b6889fac7480 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:17.197427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:17.198295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.198958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.199381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.200595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:17.202741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac39ee-f417-4356-a634-d8dd52a0ed4b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:17.212937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:17.213747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.214094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.214431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.215354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:17.217630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d6968-5e4e-4166-8a4a-10586786d06d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:17.235845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 465/931] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:17 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:26:17.236159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 466/931] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:17.284881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c321f6-34c5-4914-b630-99333d74a8fd None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.285187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c321f6-34c5-4914-b630-99333d74a8fd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.285423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c321f6-34c5-4914-b630-99333d74a8fd None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.287047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 466/932] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:17.293425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.294000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.294504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.315062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:17.316927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:17.408861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 467/933] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:17.678232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c321f6-34c5-4914-b630-99333d74a8fd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:17.784093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c321f6-34c5-4914-b630-99333d74a8fd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:17.818737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:17.819345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.819650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.819985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.821133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:17.822555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:17.825179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING keystone.server.flask.common [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 08:26:17.859659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.sql.core [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 08:26:17.859659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 08:26:17.859659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [parameters: {'id': '692a1eaab9e84d08963d256bd2455411', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 08:26:17.859659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f0240306-83e3-4b6e-a521-a111ee1ea134 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 692a1eaab9e84d08963d256bd2455411.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 692a1eaab9e84d08963d256bd2455411. Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:26:17.860435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 08:26:17.861244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application yield resource Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise self.value Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application session.commit() Aug 17 08:26:17.862212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.session.flush() Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application compat.raise_( Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 08:26:17.863107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 08:26:17.864144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application result.read() Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:26:17.864948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [parameters: {'id': '692a1eaab9e84d08963d256bd2455411', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:17.867942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:17.869805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 692a1eaab9e84d08963d256bd2455411. Aug 17 08:26:17.872712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:17.874690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 467/934] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Aug 17 08:26:17 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:17.879860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:17.931509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:17.959649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb03ce-4fc1-4e93-b947-4ec2380ffbab None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.959978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb03ce-4fc1-4e93-b947-4ec2380ffbab None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.960190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb03ce-4fc1-4e93-b947-4ec2380ffbab None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.966174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 468/935] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:17.976282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:17.976727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:17.977101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:17.992647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de9aa-48d7-4c62-9e04-69b419412fce None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:17.996581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:18.007349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:18.010996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:18.031686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:18.032315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:18.032599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:18.032872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:18.040153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:18.041757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:18.054159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:18.055630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:18.056573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:18.061121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 468/936] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:18.062962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:18.110774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 469/937] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:18.176095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:18.179148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caec9-c7c8-491d-b3c6-e6c99c2429ae None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:18.216102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:18.216706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:18.216982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:18.217255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:18.217913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:18.218214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:18.219649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:18.238432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 469/938] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:18.396365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:18.502622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49caa-940f-4f4d-b47b-e926f1573d5e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:18.536686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:18.537359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:18.537637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:18.537902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:18.540466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:18.549591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:18.554829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:18.555988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:18.557076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:18.561302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 470/939] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:18.566816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:18.679753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd894-64a7-4241-a6b8-f0423d1f78a5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:18.715901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:18.716747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:18.717165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:18.717576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:18.718723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:18.719178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:18.720725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:18.730379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 470/940] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:18.735851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:18.843754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f993cbc-a5b1-493f-8c97-53de07f7657f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:18.880394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:18.881027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:18.881303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:18.881573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:18.892592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:18.894153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:18.909784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:18.910794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:18.911758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:18.911758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:18.911758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:18.911758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 471/941] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:18.916938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:18.943466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.026504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea79c9-f507-4785-a893-9311a4bc7712 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.060972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.062011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.062496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.062960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.063816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:19.064313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.065900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.079111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 471/942] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:19.084728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.134292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.189451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174b07-19e0-4e54-9ee0-8bb2cb85884f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.224537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.225145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.225425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.225695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.234212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.235728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-9b6e8417-881d-491f-bf09-f2de0f009ccb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:19.247600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:19.248544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.249514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 472/943] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:19.254872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.266923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8c8f-c0cd-4a9a-9eef-6ad6109c0afe None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.267112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8c8f-c0cd-4a9a-9eef-6ad6109c0afe None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.267299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8c8f-c0cd-4a9a-9eef-6ad6109c0afe None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.268898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 473/944] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:19.275354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095d90-af85-4236-b797-90b96a6637bd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.275354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095d90-af85-4236-b797-90b96a6637bd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.275354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095d90-af85-4236-b797-90b96a6637bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.292905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-42095d90-af85-4236-b797-90b96a6637bd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:19.294095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-42095d90-af85-4236-b797-90b96a6637bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:19.346631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.362754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 474/945] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:19.367516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8c528-7290-4d47-904d-fd5530a7c628 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.372985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d1a2-184c-482e-a132-5fea7f89c766 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.373486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d1a2-184c-482e-a132-5fea7f89c766 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.373954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d1a2-184c-482e-a132-5fea7f89c766 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.379902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 475/946] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:19 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:19.381181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.381460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.381729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.403978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:19.405220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:19.415413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.416814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.417559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.418057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.419259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:19.420350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.422605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.437017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.454264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 472/947] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:19.455161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.491667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 476/948] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:19.575092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d6b10-5659-4e30-a822-092f4716453b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.621759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.622660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.623132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.623654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.632680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.635286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.636944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.638617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:19.656138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:19.657176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:19.658102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:19.658102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:19.658102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:19.658102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 473/949] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:19.664106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.763753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357618c1-78d5-4dd2-94eb-655a35db7857 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.784867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9457d-cf2c-40e9-8bac-5cd5e39316bc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.807710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.808629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.808912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.809351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.810274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.811734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.820670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:19.820826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:19.821878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:19.822757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.823518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.823518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.823518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.823518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:19.823518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.824431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.826771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 477/950] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:19.827468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.842329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 474/951] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:19.842329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.865900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.896039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:19.941967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b01e7-4ff9-4220-b450-00922119059a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.948374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202c29-1056-4ce1-a12e-276efa04cbbc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:19.978403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.979043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.979320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.979612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.980194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.981557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:19.986715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:19.987535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:19.988015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:19.988479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:19.989274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:19.989745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:19.990383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:19.991348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:19.992275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 478/952] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:19.993071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:19.994440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.001451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 475/953] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:20.002239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.104446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.110307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525f13-f8ae-463a-b075-38ae7d1773d5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.112787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37569f-2d0d-4605-8107-a8a082319d7a None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.126414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.144873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.145487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.145766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.146039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.146665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:20.146969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.148610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.148906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.149232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.149505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.149775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.158550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 476/954] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:20.158550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.160035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.161517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:20.173704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:20.174669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 479/955] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:20.175668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.264848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1f22-589c-4229-8411-749b3065c93e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.283436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fee0dd-39e1-4c13-8aa7-d61a73e8be4c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.299947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.300503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.300750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.301101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.302041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:20.302352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.303745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.313384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 477/956] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:20.313384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.325294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.325898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.326171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.326441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.327060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:20.327358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.328744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162820-3c69-47ec-bf68-4a4470a1cd3b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.333431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 480/957] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:20.334588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ce1a-3214-4972-96b5-267fe5d630ff None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.334868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ce1a-3214-4972-96b5-267fe5d630ff None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.335142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ce1a-3214-4972-96b5-267fe5d630ff None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.336931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 481/958] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:20.337623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ce1a-3214-4972-96b5-267fe5d630ff None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.359310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.373554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.437915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94ae-40bf-4826-8bd9-999cdcefb01d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.460306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ce1a-3214-4972-96b5-267fe5d630ff None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.476651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.477630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.477630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.477802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.479146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:20.479146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.480252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b14ae-2aab-4c2f-b625-6111447db6b9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.494641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 478/959] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:20.495881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.496164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.497063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.499712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.500572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.500572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.500867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.501504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.502857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.517178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:20.518373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:20.536084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 482/960] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:20.537473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.620043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 479/961] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:20.669851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ad47-14ca-4f39-a543-36a6cd23cb67 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:20.680568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.708767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:20.709480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:20.709761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:20.710035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/a87ac9986eb54e468cc292bcecbeeb90/roles/631d55b7080449738c732c362c40e446` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:20.712304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=a87ac9986eb54e468cc292bcecbeeb90, role_id=631d55b7080449738c732c362c40e446)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:20.713733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:20.729751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 483/962] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:20 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/a87ac9986eb54e468cc292bcecbeeb90/roles/631d55b7080449738c732c362c40e446 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:26:20.890050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:20.921685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:20.997089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7426017-d7a2-49f4-8be5-e311bd1c9b5b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:21.037021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:21.037633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:21.037913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:21.038191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:21.038855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:21.040315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:21.042845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING keystone.server.flask.common [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 08:26:21.056420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.sql.core [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 08:26:21.056420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 08:26:21.056420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [parameters: {'user_id': '429309f1ac1045d3bd7e2cb693a90ddb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 08:26:21.056420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81594) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application result.read() Aug 17 08:26:21.073786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:26:21.074790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application yield resource Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application next(self.gen) Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise self.value Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application session.commit() Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 08:26:21.075933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self.session.flush() Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application compat.raise_( Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 08:26:21.076853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 08:26:21.077772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application conn.query(q) Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application result.read() Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 08:26:21.078665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [parameters: {'user_id': '429309f1ac1045d3bd7e2cb693a90ddb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:21.079521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 08:26:21.081889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:21.083979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 480/963] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 17 08:26:20 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:21.085200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:21.193077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b13c86-2206-44ab-a593-6d2f9edf9a72 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:21.231581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:21.231581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:21.231581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:21.231581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:21.237091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:21.246470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:21.248247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f0e9d2e3-a43c-4798-b9f2-7d23ea76f8c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:21.261143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:21.262196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 08:26:21.263204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:21.265293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 484/964] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:21.271361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:21.376113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:21.378484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912def0-13a2-4859-a787-b8f9c25d4804 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:21.415144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:21.415773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:21.416052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:21.416323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:21.417028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:21.417330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:21.418962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce025-fb6b-47b7-bf14-08ed9fee505c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:21.458561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 481/965] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 17 08:26:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:22.305136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5630-ecee-41dd-bfdd-9c3cff5bd234 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.305660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5630-ecee-41dd-bfdd-9c3cff5bd234 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.305660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5630-ecee-41dd-bfdd-9c3cff5bd234 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.307145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 485/966] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:22.312434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ed87-c9a5-41a6-a69c-05a6c5e17849 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.312854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ed87-c9a5-41a6-a69c-05a6c5e17849 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.312999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ed87-c9a5-41a6-a69c-05a6c5e17849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.332282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9f82ed87-c9a5-41a6-a69c-05a6c5e17849 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:22.333794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9f82ed87-c9a5-41a6-a69c-05a6c5e17849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:22.403576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 482/967] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:22.523484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609afe-b06c-4b23-a039-92b2c58e3e88 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.523842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609afe-b06c-4b23-a039-92b2c58e3e88 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.524060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e609afe-b06c-4b23-a039-92b2c58e3e88 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.525513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 486/968] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:22.530462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1a81-351b-498d-aefa-f8317f9187e0 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.530746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1a81-351b-498d-aefa-f8317f9187e0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.531017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1a81-351b-498d-aefa-f8317f9187e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.551618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b76c1a81-351b-498d-aefa-f8317f9187e0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:22.552916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b76c1a81-351b-498d-aefa-f8317f9187e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:22.627086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 483/969] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:22.675500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e609afe-b06c-4b23-a039-92b2c58e3e88 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:22.687147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f21b-f302-400c-939b-783f7c8a9009 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.687763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f21b-f302-400c-939b-783f7c8a9009 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.687763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f21b-f302-400c-939b-783f7c8a9009 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.689192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 484/970] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:22.693726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.694006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.694280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.712416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:22.713681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:22.716575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:22.782978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e609afe-b06c-4b23-a039-92b2c58e3e88 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:22.785188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 485/971] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:22.820186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:22.821140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:22.821612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:22.822105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:22.822914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:22.824492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:22.840206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 487/972] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:22 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:22.890663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.000458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaafdb-b211-4bd7-be0c-76cff3694d1c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.045309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.045951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.046228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.046498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.047072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.048457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.051016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:23.058804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:23.060322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:23.061536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 486/973] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:23.063603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.065822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.124258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.173083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9da7d3-823d-4bb5-ba29-ad35eaf7d1c8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.179935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362e67-7ae8-4305-b79e-75ed7d0e506b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.208334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.208958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.209237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.209790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.216346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.216946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.217220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.217484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.218105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:23.218401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.219869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.221908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:23.229778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 487/974] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:23.229916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:23.230862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:23.231891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 488/975] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:23.234267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.235679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.303512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.344851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6672cf-e2b9-409a-9478-04b632688bcf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.345373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a642-1a78-4812-988e-93fda7d0e2a4 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.360842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.381989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.382193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.383132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.383238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.383410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.383524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.383738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.383824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.384313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:23.384416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:23.384614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.384719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.385971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.386072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.391152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 488/976] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:23.399561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 489/977] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:23.399718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.400977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.498707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c039d-c884-4a30-8820-ada55d963043 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.508475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc897fce-0c64-4988-9b4b-6864ef88ef6e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.529209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.539111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.540066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.540339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.540606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.541323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] RBAC: Adding query filter params (interface=admin, service_id=f0082d6e238541dab0f8e5464a258265, region_id=RegionOne) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:23.541591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.542978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.544874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.545910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.546193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.546737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.548295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 489/978] 10.222.0.15 () {56 vars in 1249 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/endpoints?service_id=f0082d6e238541dab0f8e5464a258265&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:23.553626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.560963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.562394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:23.576673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:23.577653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:23.578597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:23.578597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:23.578597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:23.580844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 490/979] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:23.583718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.615912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.662825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa561-af2e-489f-bc45-a4d7930bbb84 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.695631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0c8ce-1e7c-4c55-8bb4-642c18a9dea3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.698105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.698720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.698996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.699267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.699898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.701257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.719584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 490/980] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:26:23.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.747149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.747426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.747734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.748387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:23.748690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.750134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.764446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 491/981] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:23.770123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:23.834121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:23.884617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7903d7-8ae0-4e2d-b599-39c51fd31fee None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:23.918502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:23.919132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:23.919407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:23.919708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:23.927731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:23.929756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:23.942270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:23.943340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:23.944372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 491/982] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:23.949843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.038161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:24.051357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e0ba-390f-4647-b7cb-515cedb6ef28 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:24.085673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:24.086275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.086549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.086816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.087530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:24.087857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:24.089266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:24.111689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 492/983] 10.222.0.15 () {56 vars in 1149 bytes} [Wed Aug 17 08:26:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:24.113688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.217572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4806b-9217-4e7b-a16c-7c46c8a73940 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:24.234381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:24.254259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:24.254858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.255134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.255400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.322090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:24.323432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:24.427595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 492/984] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:24 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:24.428835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.531117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456e86-d1fc-46e0-bc26-23133391c586 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:24.565732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:24.566362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.566640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.566909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.576936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:24.578312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:24.585220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:24.594465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:24.595472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:24.597021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:24.597021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:24.597021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:24.597021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 493/985] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:24.601641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.619721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:24.703715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d52ac-027f-4f3c-b522-4e3022d42444 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:24.738690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:24.739294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.739660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.739940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.740578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:24.740881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:24.742264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3eaba-ddac-4b22-b8bc-37815a4c05f0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:24.758415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 493/986] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:24.760137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.793285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575a6b-0723-4994-9456-8600aaccf4d8 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.793638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575a6b-0723-4994-9456-8600aaccf4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.794108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99575a6b-0723-4994-9456-8600aaccf4d8 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.795883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 494/987] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:24.801606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.801902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.802163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.825750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:24.827691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:24.871573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89351d48-0812-43de-9226-dd9d481d0251 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:24.897946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 495/988] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:24.907452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:24.908115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:24.908400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:24.908663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:24.915393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:24.916846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:24.927965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:24.928895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:24.934911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 494/989] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:24.936581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:24.946773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.045827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f1403-5cea-454e-a851-27a554c81db6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.080384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.081175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.081457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.081728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.082415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:25.082722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.084184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.096482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 496/990] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:25.104227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.165213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.171130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.216750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e40e-b3d7-4aea-abe5-5af9b13ab2dc None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.239022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.253132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.253714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.253990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.254467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.254963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] RBAC: Adding query filter params (role.id=631d55b7080449738c732c362c40e446, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=a87ac9986eb54e468cc292bcecbeeb90) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:25.255270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.256820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.263446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 495/991] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/role_assignments?user.id=a87ac9986eb54e468cc292bcecbeeb90&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=631d55b7080449738c732c362c40e446 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:25.280866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb1fa-90ae-49cd-ab53-3ae1b6d6fd77 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.320729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.321389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.321668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.321935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.322525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.323951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:25.334037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:25.335145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:25.336071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 497/992] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:25.343701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.455721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fabea8-c866-4df5-ab68-7a41e157a425 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.479650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.492890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.493499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.493776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.494046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.494673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:25.494972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.496360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3b658-99fc-4b44-aff1-0a8ea32f5561 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.505810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 496/993] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:25.507010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.615103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887e5e7-2e2c-4102-ae46-f412ba9d77ba None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.624460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cf9e-a22a-42fd-a12c-a4e07a02c649 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.624768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cf9e-a22a-42fd-a12c-a4e07a02c649 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.625008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7cf9e-a22a-42fd-a12c-a4e07a02c649 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.626503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 497/994] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:25.631122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.631404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.631715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.648138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.649688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:25.650885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:25.656030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.656651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.656928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.657198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.657835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:25.658135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.660052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.671595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 498/995] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:25.672624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.723598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 498/996] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:25.778391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d2e4-740f-4043-864c-567de45716ec None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.811752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.812523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.812801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.813073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.813765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] RBAC: Adding query filter params (interface=public, service_id=80c2981ffe794c2f991f41fd80b3d94f, region_id=RegionOne) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:25.814069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.815416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.821261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 499/997] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/endpoints?service_id=80c2981ffe794c2f991f41fd80b3d94f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:25.826743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:25.925922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0a022-c49f-4bb0-bef9-66ce78e2fbc9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:25.942964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:25.962825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:25.963434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:25.963741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:25.964021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:25.964685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:25.966051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:25.979609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 499/998] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:26:25.994614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:26.061375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:26.107789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6b5d-e0db-4ee4-aeb9-091a7c5ef2c2 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:26.144526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:26.145159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:26.145435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:26.145706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:26.146294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:26.147701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:26.156651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:26.157646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:26.158699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 500/999] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 17 08:26:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:26.165873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:26.267250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89e6ed-e1ee-404b-9238-b1c0baee9fe6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:26.301294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:26.301950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:26.302230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:26.302499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:26.303124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:26.303425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:26.305384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:26.315008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 500/1000] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:26.316620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:26.421326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea4a26-8986-49d8-a509-ea8f5bfbfb4d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:26.446677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:26.459409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:26.460085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:26.460413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:26.460731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:26.461447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:26.461746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:26.463093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600fbcf-5014-4890-b7da-122946ec10ef None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:26.472628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 501/1001] 10.222.0.15 () {56 vars in 1122 bytes} [Wed Aug 17 08:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:26.474470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:26.522847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:26.577993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bec4-4722-43d3-8380-38a22fd24dee None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:26.619314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:26.619952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:26.620226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:26.620493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:26.621152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:26.622504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5bcae-8c04-4521-9d91-280a96a68554 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:26.643563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 501/1002] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:27.218602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c775-2b2b-4a91-9ca9-9eec4c4a09ec None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.219146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c775-2b2b-4a91-9ca9-9eec4c4a09ec None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.219146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c775-2b2b-4a91-9ca9-9eec4c4a09ec None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.220666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 502/1003] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:27.225514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.225909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.226243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.244157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:27.245333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:27.322045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 502/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:27.588718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42c775-2b2b-4a91-9ca9-9eec4c4a09ec None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:27.696533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42c775-2b2b-4a91-9ca9-9eec4c4a09ec None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:27.732370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:27.732996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.733268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.733532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] PATH_INFO: `/v3/services/image` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.734108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:27.735462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-76c35470-4f91-4456-a05d-c5d280e53636 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:27.744664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:27.745675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:27.746534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 503/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 17 08:26:27 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:27.751712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:27.782353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:27.857149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5130611-ac7c-406f-bf12-dfd9e1ed0db8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:27.872057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8cf3-7e14-4b72-8d0a-baadaf6a2221 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.872659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8cf3-7e14-4b72-8d0a-baadaf6a2221 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.872659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8cf3-7e14-4b72-8d0a-baadaf6a2221 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.874101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 504/1006] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:27.878600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.878883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.879155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.894608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:27.895219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:27.895495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:27.895793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:27.896416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] RBAC: Adding query filter params (name=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:27.896715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:27.896867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:27.898046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:27.898160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:27.907521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 503/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:27.909269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:27.952289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:27.977664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 505/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:28.007279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:28.015091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a15f-3609-4423-bd4c-9bcae1757832 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:28.049744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:28.050348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.050625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.050897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.051520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] RBAC: Adding query filter params (type=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:28.051860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:28.053221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:28.063832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 504/1009] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:28.245749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:28.345344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8922b1-e18a-4440-82e2-cb0d648b74c6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:28.379601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:28.380229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.380510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.380779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.381358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:28.382768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e11beebb-f6a6-4464-9a2e-4d6bb9767785 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:28.391627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:28.392684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 08:26:28.393559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:28.395607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 506/1010] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:28.399161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:28.499244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7dde-555f-49b3-8d87-03408b324b92 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:28.534560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:28.535166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.535441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.535739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.536358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:28.536660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:28.538013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad0c8-2727-4961-9eeb-3a7d5d000b76 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:28.542891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf51a-ba20-4ed1-af5c-616f0969b812 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.543190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf51a-ba20-4ed1-af5c-616f0969b812 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.543446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf51a-ba20-4ed1-af5c-616f0969b812 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.544963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 507/1011] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:28.549382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 505/1012] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:28.549537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccf51a-ba20-4ed1-af5c-616f0969b812 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:28.549737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.550074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.550287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.567612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:28.568799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:28.586666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:28.607284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:28.640671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 506/1013] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:28.668893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccf51a-ba20-4ed1-af5c-616f0969b812 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:28.703805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:28.704405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.704678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.704946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.705816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:28.706114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:28.707460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:28.717701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 508/1014] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 17 08:26:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:28.718683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:28.819061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93e424-4eeb-4073-88c8-104eae7e3908 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:28.853912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:28.854732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:28.855155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:28.855615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:28.856406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:28.857915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:28.879619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 507/1015] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:28.914917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:29.027831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42cc-8fd1-44a1-8805-77eaa7f019f1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:29.037219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:29.072583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:29.073144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:29.073414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:29.073732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:29.074849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:29.076301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84507-01e3-4b02-b1b4-80cbf63095bf None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:29.077858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 509/1016] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:29.085456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:29.098446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:29.199454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f8d80-c28c-4905-a8fa-f8174ad23e54 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:29.232379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:29.232984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:29.233262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:29.233534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:29.234181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:29.235625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723853b-cee8-4b1f-bccf-6ee26189041d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:29.263920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 508/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:29 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:26:29.980304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae3c1-1c43-4668-b72c-071088cc4439 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:29.980844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae3c1-1c43-4668-b72c-071088cc4439 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:29.980844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae3c1-1c43-4668-b72c-071088cc4439 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:29.982333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 510/1018] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:29.987246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b5c-3b03-4c0f-af32-8d28b676d09a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:29.987664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b5c-3b03-4c0f-af32-8d28b676d09a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:29.987835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b5c-3b03-4c0f-af32-8d28b676d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:30.005770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-76f27b5c-3b03-4c0f-af32-8d28b676d09a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:30.006944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76f27b5c-3b03-4c0f-af32-8d28b676d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:30.065883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:30.079960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 509/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:30.349434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ae3c1-1c43-4668-b72c-071088cc4439 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:30.453682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ae3c1-1c43-4668-b72c-071088cc4439 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:30.486871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:30.487470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:30.487767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:30.488034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:30.488676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:30.490018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35781b56-7f4f-43f3-ae5c-13f92df12e3a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:30.506074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 511/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:30 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:30.889780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b1f3-beac-4f92-b0cd-eb22c0c79ef2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:30.890163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b1f3-beac-4f92-b0cd-eb22c0c79ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:30.890354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b1f3-beac-4f92-b0cd-eb22c0c79ef2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:30.891823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 510/1021] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:30.896701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722cc4-5cb1-4aee-8656-d9f34c357e6e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:30.896988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722cc4-5cb1-4aee-8656-d9f34c357e6e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:30.897261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722cc4-5cb1-4aee-8656-d9f34c357e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:30.915382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-33722cc4-5cb1-4aee-8656-d9f34c357e6e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:30.916585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-33722cc4-5cb1-4aee-8656-d9f34c357e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:30.942871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:30.993361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 512/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:31.187761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c868-45cc-4406-962b-44c4cacf41b9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.188247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c868-45cc-4406-962b-44c4cacf41b9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.188247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511c868-45cc-4406-962b-44c4cacf41b9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.189687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 511/1023] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:31.194639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.194927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.195199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.213668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:31.214847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:31.260237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511c868-45cc-4406-962b-44c4cacf41b9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.285708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 513/1024] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:31.363290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511c868-45cc-4406-962b-44c4cacf41b9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.396373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.396997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.397277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.397545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.408113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:31.412942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:31.414500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:31.415381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 512/1025] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:31.420597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.508848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:31.521180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bc6ed-d97d-4119-a531-4103842ac9b3 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.554247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.557549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.558156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.558431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.558698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.559361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:31.559710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:31.561062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:31.570197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 514/1026] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:31.575639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.610191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:31.667382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e552-e3b5-4092-96cb-305262ce90d0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.690975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680d46-ccb3-45f1-8326-48e7ed050824 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.700788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.701414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.701687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.701955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.703046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:31.704491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:31.706301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 513/1027] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:31.711793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.732785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.733407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.733796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.734063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.745564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:31.747195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:31.763995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:31.765023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:31.770997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:31.770997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:31.770997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:31.770997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 515/1028] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:31.773336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:31.777013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:31.812898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29396d3-8c8b-4267-b90e-a605fbf60fc7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.831112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:31.849147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.849751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.850027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.850300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.850960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:31.852482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:31.879595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 514/1029] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:26:31 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:26:31.895366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c49ab-1911-456a-b80b-0c8b71bef1a7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:31.934734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:31.935364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:31.935673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:31.935947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:31.936611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:31.936915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:31.938411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:31.957665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 516/1030] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:31.958934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.071026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327753-1dec-402a-9a1c-9b3541e95849 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.106076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.106715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.106991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.107284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.115646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.117619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:32.128928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:32.129955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:32.130971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 515/1031] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:32.137864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.201620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.240415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a0614-59b5-4c70-849a-1dccf2785650 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.274850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.275458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.275758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.276027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.276748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:32.277047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.278456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250fc98-a236-4215-b3ed-2756249832e2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.295949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 517/1032] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:32.301820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.338821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.407435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776fd6-d88e-4b7f-9c84-1d12dbfbf1fe None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.426354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815ad-7540-4ade-bad1-02aa0b032845 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.426638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815ad-7540-4ade-bad1-02aa0b032845 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.426915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815ad-7540-4ade-bad1-02aa0b032845 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.428292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 518/1033] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:32.433766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.434050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.434332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.445045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.445895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.446355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.446808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.452263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:32.453458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:32.529808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.531531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.531710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 519/1034] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:32.565608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.642669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 516/1035] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:32.648088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.701781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.753572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56d9f6-97d2-44e6-9aa2-3c77a5d73e7d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.788124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.789301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.789579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.789848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.794816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.801494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.802943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:32.819246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:32.820474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:32.822256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:32.822256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:32.822256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:32.822256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 520/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:32.825844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.907792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c63dc-c224-4488-a7eb-bfc3119e8d04 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.933883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63be0e-e71d-40e9-a545-39bdf413c04a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:32.935795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.943087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.943750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.944031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.944306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.944922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.946278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.948162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:32.956630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:32.957658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:32.958523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:32.966861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 517/1037] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:32.967821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:32.976676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:32.977701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:32.977988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:32.978260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:32.978912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:32.979584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:32.981270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:32.993477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 521/1038] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:32.998992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.080253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249646e-94e4-4024-aceb-6f93487f6ab3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.112850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b33dae-e506-4a34-8cb7-2dd08e6166ce None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.114985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.115610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.115889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.116161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.116817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:33.117116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.118471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.123263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 518/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:33.129001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.154603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.155232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.155510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.155813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.162631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.164156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:33.175319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:33.176445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:33.177590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:33.181236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 522/1040] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:33.182102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.199865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:33.210859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:33.243181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878956d-79bc-4ec0-826f-a44019573d47 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.279496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.280234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.280510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.280803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.281397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] RBAC: Adding query filter params (type=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:33.281694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.283302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.293284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06646b-95f2-48c0-a8b5-7c3940d3fd0d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.293458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 519/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:33.294257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.327285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.327925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.328212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.328474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.329250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:33.329478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.331169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.349375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 523/1042] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:33.350380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.406635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97f2a-21a9-4c58-a2b3-efe681f9003c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.433537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:33.442399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:33.443310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.443950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.444230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.445053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.445763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] RBAC: Adding query filter params (interface=public, service_id=2b9395244b4a44d5bced95a98601bd26, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:33.446077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.447502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.452853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 520/1043] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:26:33 2022] GET /identity/v3/endpoints?service_id=2b9395244b4a44d5bced95a98601bd26&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:33.458532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:33.464545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9870a-ce7d-4b23-9596-30cdb80287e6 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.501174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.501774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.502054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.502326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.503042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] RBAC: Adding query filter params (role.id=631d55b7080449738c732c362c40e446, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:33.503355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.504816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87a043-85c3-483e-957c-bcb9eca2926c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.510879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 524/1044] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:33 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=631d55b7080449738c732c362c40e446 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:33.572988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806cd69-d09a-4f78-8849-011999730038 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:33.618232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:33.618855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.619131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.619400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.620059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:33.621454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f61337-cbe9-4244-a56b-0539b9dd3b79 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:33.629064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 521/1045] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:26:33 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:26:33.859944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc621a7-db9d-480d-8306-3aa4fec38ff2 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.860131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc621a7-db9d-480d-8306-3aa4fec38ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.860409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc621a7-db9d-480d-8306-3aa4fec38ff2 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.861889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 525/1046] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:33.867416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:33.867732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:33.868006 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:33.886086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:33.887446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:33.939295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:33.960451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 522/1047] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:34.228408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc621a7-db9d-480d-8306-3aa4fec38ff2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:34.330445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc621a7-db9d-480d-8306-3aa4fec38ff2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:34.365610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:34.366234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:34.366538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:34.366807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:34.377191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:34.381963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:34.382937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:34.383847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:34.387964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 526/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:34.389165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:34.488541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b0092-6858-49fc-8f68-137431ceaf33 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:34.521871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:34.522473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:34.523289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:34.523577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:34.524242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:34.524544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:34.525906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:34.539470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 523/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:34.541219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:34.552340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:34.654276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f57ae-d7a4-4657-aea9-88784e5cb109 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:34.688778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:34.689419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:34.689693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:34.689959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] PATH_INFO: `/v3/users/89963c97d79d46f38a9c5dc1bff4096b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:34.705980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] RBAC: Authorizing `identity:get_user(user_id=89963c97d79d46f38a9c5dc1bff4096b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:34.707425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:34.709274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 527/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:34 2022] GET /identity/v3/users/89963c97d79d46f38a9c5dc1bff4096b => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:34.715699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:34.763347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:34.816782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf1b3-bd79-47cc-8f18-dbd6a95a03b6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:34.850831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:34.851435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:34.851741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:34.852015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:34.917338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:34.918776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:34.965068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:35.025630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 524/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 08:26:35.027281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:35.092151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:35.133300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64007-7eda-445e-9634-9af12c7e8e2a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:35.166793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:35.167417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.167721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.167992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.169103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:35.170522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9cb6-e2da-48bc-b35a-8f922974d300 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:35.177451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 528/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:35 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:35.178346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:35.277631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8a3b-eade-43b1-b60a-4e36a04520a6 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:35.311434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:35.312058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.312331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.312598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.313309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b, user.id=89963c97d79d46f38a9c5dc1bff4096b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:35.313613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:35.315020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a436a5b-403b-4c85-ab77-a2ed590c3c50 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:35.327575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 525/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:35 2022] GET /identity/v3/role_assignments?user.id=89963c97d79d46f38a9c5dc1bff4096b&scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:35.400212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd19b7-42d7-43bc-9fb9-02bcf2c42bfb None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.400734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd19b7-42d7-43bc-9fb9-02bcf2c42bfb None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.400734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd19b7-42d7-43bc-9fb9-02bcf2c42bfb None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.402284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 529/1054] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:35.407639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00422b-3659-4d2b-85ac-6a723bc37d02 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.407943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00422b-3659-4d2b-85ac-6a723bc37d02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.408190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00422b-3659-4d2b-85ac-6a723bc37d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.427275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fd00422b-3659-4d2b-85ac-6a723bc37d02 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:35.428535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fd00422b-3659-4d2b-85ac-6a723bc37d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:35.433476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:35.502409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 526/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:35.543229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf0d0-11c4-430f-ac72-31353c5cd3a6 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.543507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf0d0-11c4-430f-ac72-31353c5cd3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.543734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf0d0-11c4-430f-ac72-31353c5cd3a6 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.545236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 530/1056] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:35.550194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.550486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.550763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.569603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:35.570792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:35.645639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 527/1057] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:35.767015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf0d0-11c4-430f-ac72-31353c5cd3a6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:35.869219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf0d0-11c4-430f-ac72-31353c5cd3a6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:35.898897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:35.905456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:35.906088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:35.906364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:35.906634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:35.911326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:35.917845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:35.922603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:35.923592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:35.924840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 531/1058] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:35.929409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:35.987446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.019133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638a644-2bff-4568-91c6-4319d9ab4d6d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.031940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c89-a87b-48b4-ac60-b0a189df65cf None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.054555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.055398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.055857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.056310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] PATH_INFO: `/v3/services/image` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.056899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.058263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.066768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:36.066902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:36.068109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 08:26:36.069297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:36.070622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.070622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.070622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.070622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:36.070622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.070932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.073564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 528/1059] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 17 08:26:35 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:36.074197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.079090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 532/1060] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:36.084560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.141344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.182307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60550f8-6d0e-4a61-9570-a3181cf9f6dd None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.190417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef200d8-a1bc-448b-af3e-ae0929e877ab None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.217474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.218068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.218345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.218614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.219229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] RBAC: Adding query filter params (name=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:36.219529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.220927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.222292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.232313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 529/1061] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:36.232896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.233343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.233544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.233823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.234100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.246362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.247911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:36.262855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:36.263891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:36.264838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:36.264838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:36.264838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:36.268771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 533/1062] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:36.269598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.345208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca16f2-5486-4438-a9d6-ff61d180346f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.377967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94909e9f-ac93-41e2-b487-7eee83fa4959 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.380440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.381534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.381534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.381764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.382783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:36.383088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.384519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.387410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.395183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 530/1063] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:36.396366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.421533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.422139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.422415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.422684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.423321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:36.423668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.425024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.441384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 534/1064] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:36.442378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.468414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.510608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e703-1433-4dca-9c8f-90b3eb70f7b8 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.545424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.545931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.546209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.546482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.547131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.548511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.552984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dfa33-036e-4316-b702-93d355b97363 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.571709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 531/1065] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:26:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:26:36.606765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.607449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.607757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.608075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.618927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.620463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:36.634109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:36.635158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:36.636523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:36.637561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 535/1066] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:36.641396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.753807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666150fc-e36a-45df-a909-b085bfb91c5c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.773383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.793106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.793718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.793994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.794265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.794995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:36.795300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.796810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.815277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 532/1067] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:36.821390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:36.848254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:36.926723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc1a0-9271-4bcf-8c1b-77a10482fbc1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:36.961457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:36.962086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:36.962364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:36.962633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:36.973363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:36.974793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:36.989405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:36.990380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:36.991950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:36.991950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:36.991950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:36.995669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 536/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:36.997019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.099715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106485a-c3f4-4fb4-9ad8-12da217346a3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.134470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.135084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.135361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.135652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.136286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:37.136587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:37.137977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8a1db-ae2f-4176-baa7-66a076c024d1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:37.149376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 533/1069] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:37.154788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.215799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a28-f67f-4eb2-815a-397f61647e02 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.216131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a28-f67f-4eb2-815a-397f61647e02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.216343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1a28-f67f-4eb2-815a-397f61647e02 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.217810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 534/1070] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:37.222468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.222749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.223020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.233104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:37.241725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:37.242907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:37.261002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ead00-1f46-4fe9-88c4-ed73386986c3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.272111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:37.298578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.299102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.299375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.299675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.306688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:37.308464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:37.315874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 535/1071] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:37.319807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:37.320734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:37.321663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 537/1072] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:37.326518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.428422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c895c-d489-4d9a-88df-f04a7c647d61 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.462956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.463577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.463858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.464128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.464814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:37.465117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:37.466548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:37.478531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 536/1073] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:37.484279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.586883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3264f7-318c-4695-bfd7-3434dc14562b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.597200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.626396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:37.627253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.627948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.628397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.628683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/631d55b7080449738c732c362c40e446` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.631434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=6e110ca44c21448c807e788a08126a99, role_id=631d55b7080449738c732c362c40e446)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:37.633458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:37.635877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:37.655583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 538/1074] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:37 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/6e110ca44c21448c807e788a08126a99/roles/631d55b7080449738c732c362c40e446 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:26:37.719481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47044-8ea2-47c1-a412-bec581475b20 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.754444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.755087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.755364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.755663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.768166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:37.773574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:37.774636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:37.775500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:37.779914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 537/1075] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:37.781080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:37.884777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955c99-de63-43ce-8a6c-a8f979733f8f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:37.918258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:37.918864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:37.919144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:37.919412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:37.920112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:37.920414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:37.921770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:37.931068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 539/1076] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:37.936676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:38.021998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:38.038121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ed5f-fefb-4557-ab37-4146f749f8fa None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:38.072070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:38.072691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:38.072971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:38.073241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] PATH_INFO: `/v3/users/89963c97d79d46f38a9c5dc1bff4096b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:38.074363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] RBAC: Authorizing `identity:get_user(user_id=89963c97d79d46f38a9c5dc1bff4096b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:38.075811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:38.077538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 538/1077] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:37 2022] GET /identity/v3/users/89963c97d79d46f38a9c5dc1bff4096b => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:38.083380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:38.145294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:38.191699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafb93-5d33-4a37-9796-64c13a756782 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:38.227216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:38.227876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:38.228155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:38.228422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:38.229527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:38.230946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3580e7-f8c1-43f0-a1ab-168b01168937 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:38.237427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 540/1078] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:38 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:38.238541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:38.339256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ea0-902c-46e8-98f2-7a425d3c59e0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:38.372595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:38.373244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:38.373521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:38.373791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b/users/89963c97d79d46f38a9c5dc1bff4096b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:38.375765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] RBAC: Authorizing `identity:create_grant(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b, user_id=89963c97d79d46f38a9c5dc1bff4096b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:38.377197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd69aa-c2cb-482d-b630-6ca0a429cc5e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:38.399572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 539/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:38 2022] PUT /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b/users/89963c97d79d46f38a9c5dc1bff4096b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:26:38.527928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc771c0-40e9-440c-81a1-8900b3e50572 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:38.528447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc771c0-40e9-440c-81a1-8900b3e50572 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:38.528447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc771c0-40e9-440c-81a1-8900b3e50572 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:38.530074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 541/1080] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:38.535357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:38.535679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:38.535956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:38.555418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:38.556721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:38.567279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:38.633709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 540/1081] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:38.908551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc771c0-40e9-440c-81a1-8900b3e50572 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:39.013687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc771c0-40e9-440c-81a1-8900b3e50572 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:39.037943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:39.050405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:39.051016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:39.051292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:39.051594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:39.120791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:39.122234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:39.223653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 542/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:39.227300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:39.326503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f520b-227b-42c1-92ff-6057e451a9b7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:39.364787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:39.365422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:39.365699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:39.365971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:39.376211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:39.377656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:39.380546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-f836cf5e-0ff3-4ca9-8157-08317e01c3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:39.395349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:39.396527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:39.397515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:39.397515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:39.397515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:39.399608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 541/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:39.403265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:39.433619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:39.514887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b70d90-2968-48b1-ab2c-d343b07dfa70 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:39.548803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:39.549413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:39.549671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:39.549941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:39.550638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:39.550943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:39.552325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:39.560399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae955-d3ab-4316-af16-75d7e4045666 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:39.560672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae955-d3ab-4316-af16-75d7e4045666 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:39.560965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae955-d3ab-4316-af16-75d7e4045666 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:39.562280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 542/1084] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:39.567052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:39.567325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:39.567680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:39.567892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 543/1085] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:39.588893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:39.590381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:39.671628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 543/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:39.936846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.020600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.036155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57a06-5239-49c8-96a7-b4da4d3bc916 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.069403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.070023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.070297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.070565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.081047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:40.085763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:40.086848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:40.087740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 544/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Wed Aug 17 08:26:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:40.092926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.189542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4390-94df-4ce7-8a90-86b07e3502cb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.214674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.223711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.224316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.224595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.224866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.225553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:40.226406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.227786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653adeb5-4903-4614-a506-dce83f605124 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.235534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 544/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:40.241978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.292995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d19b-21b8-4f8f-af98-fe3fde35e09d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.293274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d19b-21b8-4f8f-af98-fe3fde35e09d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.293542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d19b-21b8-4f8f-af98-fe3fde35e09d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.294872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 545/1089] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:26:40.299861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.300142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.300419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.318402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:40.320235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:40.341606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f727-cb03-4a2c-be74-89be8c3aa105 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.374895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.375515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.375826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.376099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.385106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 546/1090] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:26:40.387378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.388851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.391310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:40.403374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:40.404585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:40.405699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:40.405699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:40.405699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:40.407684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 545/1091] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:40.410255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.504383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa521-d7a0-4ec0-9bd7-d24c65d28910 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.521024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.537487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.538123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.538406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.538674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.539303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:40.539628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.540978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.551744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 547/1092] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:40.557738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.654783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.665987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58f3e-761c-465f-bbab-6a1c48e09a18 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.699432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.700087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.700369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.700636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.708331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.709720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:26:40.720712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:40.721719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:40.722689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 546/1093] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:26:40.728053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.754198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be1908-d13f-4710-b5fc-c31b367aef54 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.781919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.787296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf151-605e-432f-aead-c182696b28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.788477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf151-605e-432f-aead-c182696b28df None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.788849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf151-605e-432f-aead-c182696b28df None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.789032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf151-605e-432f-aead-c182696b28df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.799320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf151-605e-432f-aead-c182696b28df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-638cf151-605e-432f-aead-c182696b28df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:26:40.804624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:40.805796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:26:40.806654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 548/1094] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:40.811942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf151-605e-432f-aead-c182696b28df None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.828746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc1e7-f0ae-4420-9494-bae696e5dae0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.851092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:40.862734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.863331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.863633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.863903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.864624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:40.864924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.867164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.883623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 547/1095] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:40.889211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.911400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf151-605e-432f-aead-c182696b28df None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:40.944623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:40.945220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:40.945505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:40.945775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:40.946428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:40.946727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:40.948128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:40.956989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 549/1096] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:40.963169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:40.987990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f88d6-f724-47f8-9455-7516f2acc21a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.001658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.022114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.023247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.023525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.023818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.057026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.059836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a191c03-fa65-4548-a805-9eeaabf73bf4 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.090295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.091768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.093833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.094465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.094737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.095013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] PATH_INFO: `/v3/users/89963c97d79d46f38a9c5dc1bff4096b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.096161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] RBAC: Authorizing `identity:get_user(user_id=89963c97d79d46f38a9c5dc1bff4096b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.097585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.099166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 550/1097] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/users/89963c97d79d46f38a9c5dc1bff4096b => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:41.105677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.191279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 548/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 08:26:41.197068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.211398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.214841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e5cb-eccf-4e25-b871-11bff77f584b None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.249172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.249771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.250048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.250325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.283722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.294322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e031e-3fdb-423c-83f4-e85ed3ef844d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.316746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.318122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.327601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.328222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.328495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.328764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.339321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.340778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:26:41.355256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:41.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:26:41.357371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:26:41.357371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:26:41.357371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:41.357371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 549/1099] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:41.362133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.418174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 551/1100] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 08:26:41.424105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.426686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.462287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082b93b-388f-4217-9e3e-425e2c4e9e8f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.488149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.497611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.498204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.498476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.498755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.499381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:41.499711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.501056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.513064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 550/1101] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:41.518722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.524966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4ec97-3d2f-4255-8b35-bad2ed339a76 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.557984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.558595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.558879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.559149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.560278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.561692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.563307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 552/1102] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:41.569974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.623585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2341-1449-4eb8-97cf-64f482358970 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.649957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.662856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.663547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.663831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.664096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.671813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.673004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0b7ea-d91f-4b18-b6f9-8529a0906e86 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.673239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:26:41.684594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:26:41.685523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:26:41.686438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 551/1103] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:26:41.691467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.707771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.708364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.708639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.708905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.709608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b, user.id=89963c97d79d46f38a9c5dc1bff4096b) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:41.709912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.711315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.714001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:41.722683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 553/1104] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/role_assignments?user.id=89963c97d79d46f38a9c5dc1bff4096b&scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:41.800540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e793c-b254-4786-8f87-3ecabf91d6b3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.837087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.837727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.838076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.838419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.839196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:41.839643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.841201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc99f-e781-4309-92d1-90ff77162c06 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:41.853871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 552/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:41.860189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:41.963141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93481f-b140-4138-9cdb-07eec804858c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:41.995811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:41.996406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:41.996682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:41.996951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:41.997661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] RBAC: Adding query filter params (role.id=631d55b7080449738c732c362c40e446, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=6e110ca44c21448c807e788a08126a99) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:41.997967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:41.999392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6f8e1-d2e0-44b9-aad7-da6f5b392314 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:42.005162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 554/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:41 2022] GET /identity/v3/role_assignments?user.id=6e110ca44c21448c807e788a08126a99&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=631d55b7080449738c732c362c40e446 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:43.643597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dfc5-5818-4325-a62f-27a32bd206aa None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:43.644018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dfc5-5818-4325-a62f-27a32bd206aa None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:43.644140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dfc5-5818-4325-a62f-27a32bd206aa None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:43.645470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 553/1107] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:43.650582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:43.650972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:43.651127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:43.669376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:43.670566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:43.727770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:43.736027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 555/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:44.002243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0dfc5-5818-4325-a62f-27a32bd206aa None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:44.049571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:44.103094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0dfc5-5818-4325-a62f-27a32bd206aa None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:44.135625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:44.136239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:44.136518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:44.136786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:44.137892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:44.139303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160ac4-50db-47ef-85cc-51acae444f31 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:44.140883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 554/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:44.146524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:44.242886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780a791-c0ce-42ef-9557-a842d48e06b5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:44.275608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:44.276145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:44.276425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:44.276693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:44.277330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:44.278742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fa19c-ba9d-40e0-94ae-56e16c9f5c75 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:44.298904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 556/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:26:44 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:46.219631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd956-4510-4d15-b763-c1283d615849 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:46.220154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd956-4510-4d15-b763-c1283d615849 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:46.220242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd956-4510-4d15-b763-c1283d615849 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:46.221528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 555/1111] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:46.226704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:46.227099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:46.227252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:46.245316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:46.246492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:46.290261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:46.310627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 557/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:46.577426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd956-4510-4d15-b763-c1283d615849 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:46.679251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd956-4510-4d15-b763-c1283d615849 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:46.692680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:46.712396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:46.713013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:46.713290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:46.713562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] PATH_INFO: `/v3/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:46.714946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] RBAC: Authorizing `identity:get_role(role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:46.716328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:46.717625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 556/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:46 2022] GET /identity/v3/roles/599414de16304217a39bf1ab5b7d8724 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:46.723400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:46.819128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954ad1-3157-471c-b697-0c36bf0421a4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:46.852165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:46.852715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:46.852990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:46.853256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] PATH_INFO: `/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:46.867490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] RBAC: Authorizing `identity:get_user(user_id=32a4a6b71a7449b1a3ca5a2527fd5b1c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:46.868932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:46.870496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 558/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:46 2022] GET /identity/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:46.876170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:46.972308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99736a33-fa03-4ff5-92f9-f502102d12e8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:47.004255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:47.004834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:47.005108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:47.005383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:47.052158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:47.070008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:47.071411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:47.170857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 557/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:47.176703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:47.215009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:47.271592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10056c-e313-4c75-865d-2685fae8d631 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:47.304150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:47.304759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:47.305050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:47.305314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:47.306399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:47.307831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c51e-bd68-413f-ab2a-e7c78f9c0630 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:47.309412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 559/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:47 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:47.315562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:47.395894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:47.413970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029eca4-e80e-46f3-aeb0-7fecc1e713e3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:47.447308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:47.447868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:47.448146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:47.448417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:47.449131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b, user.id=32a4a6b71a7449b1a3ca5a2527fd5b1c) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:47.449437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:47.450860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321b1d-9e8d-4a64-986c-d67b631ab91e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:47.456422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 558/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:47 2022] GET /identity/v3/role_assignments?user.id=32a4a6b71a7449b1a3ca5a2527fd5b1c&scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b&role.id=599414de16304217a39bf1ab5b7d8724 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:26:49.276550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f437-3e0e-4f50-b4c9-ff829b2855c7 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:49.277096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f437-3e0e-4f50-b4c9-ff829b2855c7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:49.277096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f437-3e0e-4f50-b4c9-ff829b2855c7 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:49.278387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 560/1118] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:49.283689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:49.284051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:49.284235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:49.301735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:49.302915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:49.368130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 559/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:49.631768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0f437-3e0e-4f50-b4c9-ff829b2855c7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:49.729836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0f437-3e0e-4f50-b4c9-ff829b2855c7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:49.736738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:49.762665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:49.763274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:49.763568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:49.763843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] PATH_INFO: `/v3/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:49.765200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] RBAC: Authorizing `identity:get_role(role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:49.766547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:49.767869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 561/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:49 2022] GET /identity/v3/roles/599414de16304217a39bf1ab5b7d8724 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:49.773573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:49.846785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:49.870311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2721-fc96-4635-85eb-15c40cabff95 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:49.902621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:49.903235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:49.903515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:49.903827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] PATH_INFO: `/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:49.904935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=32a4a6b71a7449b1a3ca5a2527fd5b1c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:49.906353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:49.907945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 560/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:49 2022] GET /identity/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:49.913959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:50.009214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58449251-668d-4e7d-bf32-5aa568e012b7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:50.041858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:50.042455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:50.042727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:50.042994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:50.044107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:50.045498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e61c0-de6f-456d-bd8d-3b287f572398 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:50.047060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 562/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:49 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:50.052691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:50.148975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fa525-238b-4666-aa62-60f206607ce9 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:50.181389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:50.182022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:50.182296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:50.182561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b/users/32a4a6b71a7449b1a3ca5a2527fd5b1c/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:50.184660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b, user_id=32a4a6b71a7449b1a3ca5a2527fd5b1c, role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:50.186068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705472b-a597-4ec4-8c71-cb656555b8c2 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:50.198187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 561/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:26:50 2022] PUT /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b/users/32a4a6b71a7449b1a3ca5a2527fd5b1c/roles/599414de16304217a39bf1ab5b7d8724 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:26:52.032280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae52d-567e-4091-9979-0745b9a887d9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:52.032905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae52d-567e-4091-9979-0745b9a887d9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:52.032905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae52d-567e-4091-9979-0745b9a887d9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:52.034129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 563/1124] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:52.039388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:52.039823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:52.039974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:52.047151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:52.058733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:52.059983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:52.126158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 562/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:52.389207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae52d-567e-4091-9979-0745b9a887d9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:52.431769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:52.485715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae52d-567e-4091-9979-0745b9a887d9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:52.518250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:52.518851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:52.519123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:52.519387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] PATH_INFO: `/v3/roles/599414de16304217a39bf1ab5b7d8724` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:52.520769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] RBAC: Authorizing `identity:get_role(role_id=599414de16304217a39bf1ab5b7d8724)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:52.522136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:52.523408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 564/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:52 2022] GET /identity/v3/roles/599414de16304217a39bf1ab5b7d8724 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:52.529395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:52.626923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b89e8-34b9-492c-97f7-73b7187d5db1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:52.659060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:52.659643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:52.659921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:52.660188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] PATH_INFO: `/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:52.661395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] RBAC: Authorizing `identity:get_user(user_id=32a4a6b71a7449b1a3ca5a2527fd5b1c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:52.663311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:52.664891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 563/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:26:52 2022] GET /identity/v3/users/32a4a6b71a7449b1a3ca5a2527fd5b1c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:52.670657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:52.766273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bec83a-913b-41ba-9c9f-ea66ffb638ac None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:52.776407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:52.799433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:52.800054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:52.800330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:52.800604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:52.864783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:52.866784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:52.961151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 565/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:26:52.966903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:52.969766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:53.065034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66472-3a14-465e-8441-70ce5cd223b0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:53.097424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:53.098030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:53.098301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:53.098567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] PATH_INFO: `/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:53.099677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] RBAC: Authorizing `identity:get_project(project_id=8de6021e19fc4aceb1892c1cc1f3ad7b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:53.101683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff1e9-4209-4491-a18e-75f9bc7389bc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:53.103263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 564/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:26:52 2022] GET /identity/v3/projects/8de6021e19fc4aceb1892c1cc1f3ad7b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:53.109418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:53.120636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:53.204770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4f8b-2528-40cd-a80b-119e95c9c585 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:53.237967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:53.238497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:53.238770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:53.239038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:53.239776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] RBAC: Adding query filter params (role.id=599414de16304217a39bf1ab5b7d8724, scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b, user.id=32a4a6b71a7449b1a3ca5a2527fd5b1c) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:26:53.240083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:53.241521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1ac2f-98cf-4dca-8370-5cda16ed7f24 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:53.246997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 566/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:26:53 2022] GET /identity/v3/role_assignments?user.id=32a4a6b71a7449b1a3ca5a2527fd5b1c&scope.project.id=8de6021e19fc4aceb1892c1cc1f3ad7b&role.id=599414de16304217a39bf1ab5b7d8724 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:55.129588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdacc3-f084-4a27-9516-141f7302df25 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:55.130174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdacc3-f084-4a27-9516-141f7302df25 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:55.130174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdacc3-f084-4a27-9516-141f7302df25 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:55.132008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 565/1131] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:55.137256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:55.137689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:55.137789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:55.155970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:55.157144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:55.221997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 567/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:55.484448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdacc3-f084-4a27-9516-141f7302df25 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:55.552645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:55.584987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdacc3-f084-4a27-9516-141f7302df25 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:55.620704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:55.621326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:55.621604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:55.621875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:55.622975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:55.624429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d20e6-2f86-437e-9617-e139c934e41a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:55.625977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 566/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:55.631852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:55.634873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:55.727890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1090d-bbc0-43c7-857b-56a52b331509 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:55.760329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:55.760861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:55.761140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:55.761412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:55.762049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:55.763498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae6de3-fda9-481d-a642-45bcbfcb56d8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:55.789388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 568/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:26:55 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:26:57.681736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca46c8-349a-40e3-85e5-3b64b3ee6833 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:57.682233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca46c8-349a-40e3-85e5-3b64b3ee6833 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:57.682329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca46c8-349a-40e3-85e5-3b64b3ee6833 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:57.683601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 567/1135] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:26:57.688668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:57.689105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:57.689206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:57.707662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:26:57.708838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:26:57.757183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:26:57.773444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 569/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:26:58.039019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca46c8-349a-40e3-85e5-3b64b3ee6833 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:58.141135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca46c8-349a-40e3-85e5-3b64b3ee6833 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:58.173920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:58.174533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:58.174808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:58.175080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:58.176195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:58.177616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3b3c-e593-4397-9b3c-d0ccd325e789 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:58.179799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 568/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:26:58.185590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:26:58.280007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b9a7-6692-41c1-b0ef-f458c2ca9fbd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:26:58.312383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:26:58.312911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:26:58.313188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:26:58.313459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:26:58.314094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:26:58.315500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757981f-aaf6-406e-8e24-335a1b7055e1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:26:58.336113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 570/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:26:58 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:27:00.237937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818beba-8f17-499d-b860-a44c6c15eae0 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:00.238487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818beba-8f17-499d-b860-a44c6c15eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:00.238487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818beba-8f17-499d-b860-a44c6c15eae0 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:00.239826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 569/1139] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:00.244870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:00.245267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:00.245415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:00.264148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:00.265335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:00.299713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:00.330485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 571/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:00.595879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818beba-8f17-499d-b860-a44c6c15eae0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:00.605369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:00.695598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818beba-8f17-499d-b860-a44c6c15eae0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:00.729100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:00.729706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:00.729980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:00.730247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:00.740018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:00.744680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:00.745874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:00.747034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 570/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:00.751946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:00.847652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc4227-08e9-4d3e-9891-0b495486d531 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:00.880210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:00.880801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:00.881575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:00.881846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:00.882498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:00.882798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:00.884188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:00.891992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 572/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:00.898056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:00.961661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:00.995103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897391a-2964-468b-a66f-5f4121705775 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:01.029029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:01.029638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:01.029913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:01.030181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] PATH_INFO: `/v3/users/ad8b827b66044178b391fd38c4f86308` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:01.042720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] RBAC: Authorizing `identity:get_user(user_id=ad8b827b66044178b391fd38c4f86308)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:01.044186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:01.045748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 571/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:00 2022] GET /identity/v3/users/ad8b827b66044178b391fd38c4f86308 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:01.051513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:01.085710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:01.149012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc2d5d-7c80-419b-a66e-21f84d11d7d3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:01.180916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:01.181504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:01.181780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:01.182050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:01.246290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:01.247744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:01.278709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:01.342221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 573/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:27:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:27:01.348060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:01.444774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0f47b-4b27-4463-9515-505dd0a58288 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:01.467274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:01.477821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:01.478434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:01.478711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:01.478982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] PATH_INFO: `/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:01.480101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3583c4fa7c4c47b031e2e444a7353e)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:01.481509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447175-4725-4588-998d-965e86e936e5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:01.483086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 572/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:01 2022] GET /identity/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:01.488924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:01.583368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5dee6-d589-4246-9bc2-8136571cd458 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:01.616909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:01.617505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:01.617779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:01.618047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:01.618755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=3b3583c4fa7c4c47b031e2e444a7353e, user.id=ad8b827b66044178b391fd38c4f86308) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:01.619057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:01.620499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c098d-2de6-478b-ae57-4b41971da9cc None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:01.622177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:01.626739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 574/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:27:01 2022] GET /identity/v3/role_assignments?user.id=ad8b827b66044178b391fd38c4f86308&scope.project.id=3b3583c4fa7c4c47b031e2e444a7353e&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:03.474679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b65a-cef3-441b-a366-0499893eb11c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:03.475208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b65a-cef3-441b-a366-0499893eb11c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:03.475327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b65a-cef3-441b-a366-0499893eb11c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:03.476627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 573/1147] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:03.481623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:03.482010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:03.482164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:03.500280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:03.501455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:03.567350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 575/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:03.833126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b65a-cef3-441b-a366-0499893eb11c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:03.932163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b65a-cef3-441b-a366-0499893eb11c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:03.964419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:03.965028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:03.965303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:03.965571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:03.975916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:03.980582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:03.981677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:03.982547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 574/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:03.987362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:04.081662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2a56c-c5f0-4d4f-a524-9434dfda70cd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:04.107035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:04.115991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:04.116586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:04.116858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:04.117123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:04.117773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:04.118069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:04.119419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:04.127153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 576/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:04.132786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:04.184609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:04.230764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664f0e-1c63-41e7-9282-bfa2e957dc4f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:04.262985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:04.263614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:04.263892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:04.264163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] PATH_INFO: `/v3/users/ad8b827b66044178b391fd38c4f86308` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:04.265263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] RBAC: Authorizing `identity:get_user(user_id=ad8b827b66044178b391fd38c4f86308)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:04.266680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:04.268243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 575/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:04 2022] GET /identity/v3/users/ad8b827b66044178b391fd38c4f86308 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:04.274471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:04.370419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f995509-5687-4620-a471-cedcfeb57008 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:04.402878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:04.403484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:04.403789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:04.404060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] PATH_INFO: `/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:04.405166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3583c4fa7c4c47b031e2e444a7353e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:04.406574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720823b5-e859-450f-9b21-2b5a472fba00 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:04.408200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 577/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:04 2022] GET /identity/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:04.414395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:04.509664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83256942-27c6-46c3-bed9-0701a3350f6e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:04.528723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:04.543516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:04.544185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:04.544462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:04.544735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] PATH_INFO: `/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e/users/ad8b827b66044178b391fd38c4f86308/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:04.546617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b3583c4fa7c4c47b031e2e444a7353e, user_id=ad8b827b66044178b391fd38c4f86308, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:04.548057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f597d65-0cca-42a8-b088-b758edce1ac5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:04.560742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 576/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:27:04 2022] PUT /identity/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e/users/ad8b827b66044178b391fd38c4f86308/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:27:06.397610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa82b-da19-4ccb-8b5e-5533006e4fcb None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:06.398141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa82b-da19-4ccb-8b5e-5533006e4fcb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:06.398141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa82b-da19-4ccb-8b5e-5533006e4fcb None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:06.399473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 578/1154] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:06.404466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:06.404881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:06.404996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:06.422492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:06.423724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:06.488033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 577/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:06.759010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa82b-da19-4ccb-8b5e-5533006e4fcb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:06.815658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:06.856899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa82b-da19-4ccb-8b5e-5533006e4fcb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:06.888926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:06.889531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:06.889807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:06.890077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:06.900273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:06.904992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:06.906125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:27:06.907015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 579/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:06.912642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:07.007832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce459-9377-4c57-bb58-7c355555e246 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:07.018057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:07.041627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:07.042213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:07.042494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:07.042771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:07.043424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:07.043754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:07.045130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:07.053497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 578/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:07.059122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:07.155442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cba107-12b7-4c9a-8e74-d2357ec8bed0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:07.172138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:07.189200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:07.189809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:07.190084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:07.190354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] PATH_INFO: `/v3/users/ad8b827b66044178b391fd38c4f86308` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:07.191455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] RBAC: Authorizing `identity:get_user(user_id=ad8b827b66044178b391fd38c4f86308)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:07.192894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:07.194473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 580/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:07 2022] GET /identity/v3/users/ad8b827b66044178b391fd38c4f86308 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:07.200292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:07.298843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e85-8f75-4500-b1a5-6ad087a729be None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:07.330473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:07.331317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:07.331619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:07.331888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:07.371319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:07.397321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:07.398744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:07.493262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 579/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:27:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:27:07.499379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:07.595028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fb85-e73b-419f-a1d1-e7cd3e79f265 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:07.626541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:07.627152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:07.627426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:07.627800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] PATH_INFO: `/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:07.628891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3583c4fa7c4c47b031e2e444a7353e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:07.630294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472568b-04fb-4c4e-9887-e84d1bb12453 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:07.632434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 581/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:07 2022] GET /identity/v3/projects/3b3583c4fa7c4c47b031e2e444a7353e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:07.638506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:07.706528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:07.735351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c763bb-74a7-42d3-ade4-ee5e6c2c961e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:07.767213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:07.767965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:07.768248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:07.768515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:07.769224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=3b3583c4fa7c4c47b031e2e444a7353e, user.id=ad8b827b66044178b391fd38c4f86308) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:07.769526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:07.770925 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b94cb-e483-4a9e-99a2-2673229b0a90 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:07.776986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 580/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:27:07 2022] GET /identity/v3/role_assignments?user.id=ad8b827b66044178b391fd38c4f86308&scope.project.id=3b3583c4fa7c4c47b031e2e444a7353e&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:09.643980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4f615-9990-4281-b7f5-170aa7c4cc8d None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:09.644417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4f615-9990-4281-b7f5-170aa7c4cc8d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:09.644525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4f615-9990-4281-b7f5-170aa7c4cc8d None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:09.645850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 582/1162] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:09.651549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:09.651951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:09.652106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:09.670186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:09.671351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:09.735652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 581/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:10.000812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4f615-9990-4281-b7f5-170aa7c4cc8d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:10.056215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:10.100632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4f615-9990-4281-b7f5-170aa7c4cc8d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:10.132251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:10.132827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:10.133099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:10.133363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:10.196988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:10.198401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:10.248473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:10.291253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 583/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:27:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:27:10.297043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:10.361705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:10.394943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3ab07-d74f-476f-8599-be2e32c015c1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:10.428169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:10.428781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:10.429059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:10.429327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:10.435776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:10.437208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-d900a4b0-c2f6-483c-8093-809eb35feb97 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:10.448256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:10.449455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:10.450456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 582/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:27:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:10.455359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:10.550557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1183a-4d45-4cba-aa4e-d6ed8346495e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:10.582773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:10.583354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:10.583657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:10.584453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:10.585105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:10.585403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:10.586735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53e560-bb93-4a75-b680-71026cb7bf4c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:10.593509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 584/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Wed Aug 17 08:27:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:12.434290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cb53f-996c-4d71-8f57-34d5c039c2e3 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:12.434849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cb53f-996c-4d71-8f57-34d5c039c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:12.434849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cb53f-996c-4d71-8f57-34d5c039c2e3 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:12.436193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 583/1167] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:12.441250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ab47-54dc-4044-a7c7-bbd0f2c4bed9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:12.441622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ab47-54dc-4044-a7c7-bbd0f2c4bed9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:12.441806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94ab47-54dc-4044-a7c7-bbd0f2c4bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:12.460348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ea94ab47-54dc-4044-a7c7-bbd0f2c4bed9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:12.461544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ea94ab47-54dc-4044-a7c7-bbd0f2c4bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:12.474283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:12.526760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 585/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:27:12.790501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cb53f-996c-4d71-8f57-34d5c039c2e3 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:12.894791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cb53f-996c-4d71-8f57-34d5c039c2e3 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:12.920121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:12.929260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:12.929859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:12.930135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:12.930406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:12.931053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:12.932440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5000434-783e-463f-86f8-8257d27406fd None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:12.947749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 584/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Wed Aug 17 08:27:12 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:27:14.839025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65dbf0-1e29-43e3-8b84-af3f848a28a5 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:14.839535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65dbf0-1e29-43e3-8b84-af3f848a28a5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:14.839535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65dbf0-1e29-43e3-8b84-af3f848a28a5 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:14.840915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 586/1170] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:14.846076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:14.846511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:14.846604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:14.865969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:14.867104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:14.931557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 585/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:15.200943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65dbf0-1e29-43e3-8b84-af3f848a28a5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:15.298999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65dbf0-1e29-43e3-8b84-af3f848a28a5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:15.331515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:15.332149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:15.332424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:15.332692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] PATH_INFO: `/v3/domains/1d46cf42ba3847e7923e9379e7f2a3ed` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:15.343148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d46cf42ba3847e7923e9379e7f2a3ed)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:15.344612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e043b-57d8-486d-b9aa-34d4450f0ad6 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:15.346163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 587/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Wed Aug 17 08:27:15 2022] GET /identity/v3/domains/1d46cf42ba3847e7923e9379e7f2a3ed => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:15.352019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:15.447111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235e883-bc4e-4cec-aecb-7371b16752f9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:15.462977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:15.480504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:15.481099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:15.481378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:15.481653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:15.482293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:15.483741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c8fe-2366-4e80-8d0d-d015cbfc6e54 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:15.509188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 586/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:27:15 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:27:17.416409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b277-572c-4beb-a684-5434a23c04e9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:17.416955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b277-572c-4beb-a684-5434a23c04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:17.416955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b277-572c-4beb-a684-5434a23c04e9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:17.418264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 588/1174] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:17.423354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:17.423856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:17.423946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:17.441578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:17.442754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:17.507600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 587/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:17.781378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b277-572c-4beb-a684-5434a23c04e9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:17.792918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:17.881202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b277-572c-4beb-a684-5434a23c04e9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:17.912387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:17.912988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:17.913260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:17.913525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] PATH_INFO: `/v3/domains/1d46cf42ba3847e7923e9379e7f2a3ed` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:17.914615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d46cf42ba3847e7923e9379e7f2a3ed)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:17.916047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d758a8-7cf4-4251-894f-4adee840a574 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:17.917574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 589/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Wed Aug 17 08:27:17 2022] GET /identity/v3/domains/1d46cf42ba3847e7923e9379e7f2a3ed => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:17.923501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:18.017631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:18.021786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30a450-f7bd-4fa9-850b-e5b2a6539fb4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:18.055352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:18.055923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:18.056201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:18.056470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:18.057105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:18.058515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe05c-7548-4b0d-a571-02461f9ea99f None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:18.078581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 588/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:27:17 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:27:19.985284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d106a-86b2-4c79-9b49-98e516aef2a2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:19.985798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d106a-86b2-4c79-9b49-98e516aef2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:19.985798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d106a-86b2-4c79-9b49-98e516aef2a2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:19.987150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 590/1178] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:19.992963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:19.993366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:19.993503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:20.011680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:20.012842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:20.076633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 589/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:20.347633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d106a-86b2-4c79-9b49-98e516aef2a2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:20.423389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:20.447298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d106a-86b2-4c79-9b49-98e516aef2a2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:20.479603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:20.480214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:20.480489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:20.480759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:20.491468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:20.496140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:20.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:27:20.498312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 591/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:20.503058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:20.582503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:20.599495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c35a4-c461-4410-9f52-25b22085bf92 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:20.632841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:20.633442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:20.633723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:20.633991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:20.634647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:20.634949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:20.636343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:20.644154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 590/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:20.650056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:20.746191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21917b-2866-43ca-afe3-0981cb0f5c4f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:20.777812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:20.778412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:20.778684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:20.778949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] PATH_INFO: `/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:20.781525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:20.792474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] RBAC: Authorizing `identity:get_user(user_id=7404d18a42ae47eb9b2e2c5fdc87aefb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:20.793888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:20.795447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 592/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:20 2022] GET /identity/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:20.801295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:20.898948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5e979-25f3-4412-83af-792f2613761e None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:20.933700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:20.934295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:20.934574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:20.934846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:20.949371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:21.000564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:21.001997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:21.097155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 591/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:27:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:27:21.102980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:21.196969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2378-ad31-46f9-8bac-b55b45aa8705 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:21.229306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:21.229913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:21.230185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:21.230452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] PATH_INFO: `/v3/projects/c3ec06d41db846c68fb7d5c46787fad0` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:21.231534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] RBAC: Authorizing `identity:get_project(project_id=c3ec06d41db846c68fb7d5c46787fad0)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:21.232956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50be1-2e98-4a2c-bb37-cc38727582b9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:21.234530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 593/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:21 2022] GET /identity/v3/projects/c3ec06d41db846c68fb7d5c46787fad0 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:21.240543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:21.285686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:21.339106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9f0c-3640-4688-a005-e649722f8568 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:21.371862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:21.372454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:21.372731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:21.373001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:21.373712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=c3ec06d41db846c68fb7d5c46787fad0, user.id=7404d18a42ae47eb9b2e2c5fdc87aefb) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:21.374017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:21.375424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17118fa-d504-4929-8df4-cbb6fb1643f0 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:21.381116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 592/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:27:21 2022] GET /identity/v3/role_assignments?user.id=7404d18a42ae47eb9b2e2c5fdc87aefb&scope.project.id=c3ec06d41db846c68fb7d5c46787fad0&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:23.220926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096e96-43fb-4305-9138-7358a2c552e3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:23.221499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096e96-43fb-4305-9138-7358a2c552e3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:23.221499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096e96-43fb-4305-9138-7358a2c552e3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:23.222787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 594/1186] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:23.227854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:23.228274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:23.228386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:23.246433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:23.247641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:23.311303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 593/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:23.578665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096e96-43fb-4305-9138-7358a2c552e3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:23.642920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:23.682374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096e96-43fb-4305-9138-7358a2c552e3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:23.715010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:23.715645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:23.715921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:23.716188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:23.726302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:23.730948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:23.732161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:27:23.733093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 595/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:23.738072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:23.778047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:23.834766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ad4d3-051c-45dd-960a-bbc061d8a459 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:23.867299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:23.867920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:23.868197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:23.868464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:23.869118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:23.869414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:23.870787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:23.878576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 594/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:23.884487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:23.980818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427f663-8bda-45e0-8a68-b4e34f7471ce None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:24.002326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:24.013872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:24.014493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:24.014769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:24.015034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] PATH_INFO: `/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:24.016133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] RBAC: Authorizing `identity:get_user(user_id=7404d18a42ae47eb9b2e2c5fdc87aefb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:24.017539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:24.019080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 596/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:23 2022] GET /identity/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:24.025237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:24.120896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46771243-8ab4-4852-a428-7aeb8a5d7e5a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:24.122305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:24.154603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:24.155206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:24.155479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:24.155783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] PATH_INFO: `/v3/projects/c3ec06d41db846c68fb7d5c46787fad0` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:24.156870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] RBAC: Authorizing `identity:get_project(project_id=c3ec06d41db846c68fb7d5c46787fad0)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:24.158278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9773-d285-42c9-8592-3bc6bc578b97 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:24.159892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 595/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:24 2022] GET /identity/v3/projects/c3ec06d41db846c68fb7d5c46787fad0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:24.165599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:24.259493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc8266-39bc-4c73-a4e7-e8635df4c6ab None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:24.291557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:24.292205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:24.292479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:24.292745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] PATH_INFO: `/v3/projects/c3ec06d41db846c68fb7d5c46787fad0/users/7404d18a42ae47eb9b2e2c5fdc87aefb/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:24.294580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3ec06d41db846c68fb7d5c46787fad0, user_id=7404d18a42ae47eb9b2e2c5fdc87aefb, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:24.296008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c5a7f-9d65-4ba4-b08e-4f6085d93b43 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:24.308358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 597/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:27:24 2022] PUT /identity/v3/projects/c3ec06d41db846c68fb7d5c46787fad0/users/7404d18a42ae47eb9b2e2c5fdc87aefb/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:27:26.147717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b51e8-bd9d-4165-b070-5906f7403e2d None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:26.148285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b51e8-bd9d-4165-b070-5906f7403e2d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:26.148285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b51e8-bd9d-4165-b070-5906f7403e2d None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:26.149575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 596/1193] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:27:26.154589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:26.154975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:26.155126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:26.173449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:27:26.174618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:27:26.218551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:26.240120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 598/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:27:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:27:26.509526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b51e8-bd9d-4165-b070-5906f7403e2d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:26.609446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b51e8-bd9d-4165-b070-5906f7403e2d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:26.642015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:26.642628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:26.642901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:26.643170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:26.653488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:27:26.658119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:27:26.659246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:27:26.660181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 597/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:27:26.665183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:26.760325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2848a8-fd36-467e-b116-1ba8b1923b01 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:26.791741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:26.792356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:26.792627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:26.792891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:26.793535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:26.793831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:26.795166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:26.803225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 599/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:26.808976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:26.839666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:26.907322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90d6e1-ea97-41d0-a260-8086174fa9f0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:26.940663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:26.941265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:26.941540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:26.941810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] PATH_INFO: `/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:26.943496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] RBAC: Authorizing `identity:get_user(user_id=7404d18a42ae47eb9b2e2c5fdc87aefb)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:26.944960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:26.946492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 598/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 17 08:27:26 2022] GET /identity/v3/users/7404d18a42ae47eb9b2e2c5fdc87aefb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:26.952287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:26.995395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:27.049601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0a3d4-b1f3-4636-a3a9-6988d11c2079 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:27.082128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:27.082713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:27.082990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:27.083258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:27.147831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:27.149250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:27.189450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:27.245160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 600/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:27:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:27:27.250972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:27.343704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:27.347787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb91f4-e98d-47d7-a4e4-36cbb8844df8 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:27.382766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:27.383383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:27.383694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:27.383972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] PATH_INFO: `/v3/projects/c3ec06d41db846c68fb7d5c46787fad0` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:27.385078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] RBAC: Authorizing `identity:get_project(project_id=c3ec06d41db846c68fb7d5c46787fad0)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:27.386521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45400-9b95-46d2-85d9-a7ec0769521d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:27.388166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 599/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 17 08:27:27 2022] GET /identity/v3/projects/c3ec06d41db846c68fb7d5c46787fad0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:27.394197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:27:27.487874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a138-6db9-4201-a788-9321f9f89d2d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:27:27.520577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:27:27.521173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:27:27.521444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:27:27.521708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:27:27.522408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=c3ec06d41db846c68fb7d5c46787fad0, user.id=7404d18a42ae47eb9b2e2c5fdc87aefb) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:27:27.522708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:27:27.524131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5bc42-cc26-4f06-ad38-add6af32f1a0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:27:27.529545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 601/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:27:27 2022] GET /identity/v3/role_assignments?user.id=7404d18a42ae47eb9b2e2c5fdc87aefb&scope.project.id=c3ec06d41db846c68fb7d5c46787fad0&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:27:37.378091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=17 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:27:37.527044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:22.221608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68569-b906-4964-b243-8d4fd4abf6bc None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:22.221608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68569-b906-4964-b243-8d4fd4abf6bc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:22.221608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab68569-b906-4964-b243-8d4fd4abf6bc None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:22.221608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 600/1201] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:22.226903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:22.227422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:22.227674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:22.246640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:22.247840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:22.323695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 602/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 08:28:22.600963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68569-b906-4964-b243-8d4fd4abf6bc None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:22.741291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab68569-b906-4964-b243-8d4fd4abf6bc None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:22.787595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:22.787595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:22.787595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:22.787595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:22.803779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:22.805284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:22.826408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:22.827656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:22.829026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:22.829026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:22.829026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:22.829026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 601/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:22.835311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:22.971719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ccc3-ebe0-49e2-9041-e51f8d1ee51b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:23.006889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:23.016566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:23.017177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:23.017452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:23.017711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:23.018387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:23.018701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:23.020200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0b50-65fa-463a-ae47-be7544d42cef None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:23.033556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 603/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:23.040322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:23.111247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:23.168301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86ce0e-d3d1-484c-98c6-8e7fb9549d32 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:23.209541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:23.210153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:23.210433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:23.210707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:23.211399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:23.212870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f7ba-b1f0-4bbb-82f3-e77168028e90 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:23.256088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 602/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 17 08:28:23 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:28:25.386301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de04a-8e4a-4ef2-92f0-e93c148978c4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:25.386895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de04a-8e4a-4ef2-92f0-e93c148978c4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:25.386895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de04a-8e4a-4ef2-92f0-e93c148978c4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:25.388318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 604/1206] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:25.394240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:25.394682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:25.394783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:25.413398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:25.414595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:25.491100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 603/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:25.765001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de04a-8e4a-4ef2-92f0-e93c148978c4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:25.882914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de04a-8e4a-4ef2-92f0-e93c148978c4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:25.932902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:25.933534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:25.933813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:25.934085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:25.947728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:25.953202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:25.954293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:25.960639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 605/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:25.962781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:26.007147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:26.079022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac20c0-c525-4110-83d5-de28467b1247 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:26.121829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:26.122832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:26.123315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:26.123833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:26.125212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:26.125732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:26.128766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:26.147640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 604/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:26.150354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:26.209211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:26.264801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671f6b-152a-488d-aeea-7eabe7e57558 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:26.303163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:26.303871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:26.304243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:26.304520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:26.317722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:26.319287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:26.335408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:26.336491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:26.337410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:26.337410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:26.337410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:26.339728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 606/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:28:26.342867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:26.458861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:26.463899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc09d5e-e4c8-4129-8675-96994507fd93 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:26.501312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:26.501842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:26.502107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:26.502381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:26.503629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:26.504532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:26.505391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:26.518957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 605/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:26.524619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:26.639029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c621-88f8-401b-beb7-1e2b35509a8c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:26.640766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:26.676717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:26.677338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:26.677610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:26.677876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:26.685487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:26.686908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:26.698054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:26.699107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:26.700150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 607/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:26.705219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:26.829968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0c4c2-8187-48f2-9d09-f635f4e56217 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:26.876690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:26.877304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:26.877609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:26.878057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:26.878826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:26.879235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:26.880819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:26.901924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 606/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:26.907505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:27.022769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782228-c4f9-4755-932c-1ca37248bd9e None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:27.068599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:27.069250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:27.069572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:27.069917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:27.106439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:27.154590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:27.156479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:27.281965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 608/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:28:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:28:27.288068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:27.318516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:27.415154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afdf6-767a-4d63-93b4-4a80e9d5eae1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:27.459304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:27.460180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:27.460282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:27.460629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:27.472131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:27.473822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:27.491205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:27.492361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:27.493426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:27.493426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:27.493426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:27.493426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 607/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:27.498020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:27.565796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:27.609928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1149b-e8a7-4232-a43f-69ad0da93449 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:27.646975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:27.647606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:27.647885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:27.648153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:27.648826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:27.649129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:27.650489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:27.668098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 609/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:27.668845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:27.749017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:27.787424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d8591-d042-4bce-91d2-11a8c8a4789a None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:27.831951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:27.832585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:27.832940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:27.833215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:27.840691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:27.842245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:27.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:27.855478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:27.856599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 608/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:27.861387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:27.981648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76884c2-9bb7-4d7a-b106-ecf3cd8f9bf1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:28.007343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:28.021501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:28.022114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:28.022395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:28.022671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:28.023365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:28.023706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:28.025136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1e9dd-9d96-4f50-af55-104a91c52d59 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:28.038271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 610/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:28.044351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:28.158309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bdf82-24fd-4130-b216-521034658728 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:28.192278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:28.200551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:28.201465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:28.201768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:28.202125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:28.203142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=2c853b65b78d44a8a5656c1b84b4bff5) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:28.203682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:28.206081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7072e0-35de-4d73-8db8-5bab6d8fc46a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:28.212909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 609/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:28:28 2022] GET /identity/v3/role_assignments?user.id=2c853b65b78d44a8a5656c1b84b4bff5&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:30.223287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50897dd-ccb0-4b63-8a53-8c4aa14e59e1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:30.224024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50897dd-ccb0-4b63-8a53-8c4aa14e59e1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:30.224024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50897dd-ccb0-4b63-8a53-8c4aa14e59e1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:30.225161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 611/1220] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:30.230405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:30.230981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:30.230981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:30.249674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:30.250866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:30.322496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 610/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:30.591086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50897dd-ccb0-4b63-8a53-8c4aa14e59e1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:30.699453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50897dd-ccb0-4b63-8a53-8c4aa14e59e1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:30.734069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:30.734700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:30.734973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:30.735241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:30.745190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:30.749932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:30.750938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:30.751826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 612/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:28:30.757037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:30.864682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609788d-058f-4add-bc4d-ebc89a49f475 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:30.888715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:30.900258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:30.900862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:30.901138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:30.901405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:30.902062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:30.902361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:30.903737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:30.912655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 611/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:30.918417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:30.964582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:31.027711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602659d-7fe6-48bd-be09-d1c6e2610d37 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.067646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.068296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.068574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.068842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.079121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.081506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:31.098213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:31.099401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:31.100707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:31.100707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:31.100707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:31.100707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 613/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:28:31.105513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:31.221193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9c22-1dd4-4b29-b933-86d202f15b71 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.259015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.259698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.259922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.260171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.260814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:31.261112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.262473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.274590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 612/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:31.280738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:31.385309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:31.393044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbde7ae-6c36-44f0-844c-3c25b48959b3 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.428718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.429346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.429665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.429945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.438504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.440694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:31.452645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:31.453807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:31.455053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 614/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:28:31.460041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:31.511946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:31.571124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3806-6e78-4c1f-a111-1039d525c4ce None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.610418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.611063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.611415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.612173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.612918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:31.613345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.615018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.636205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 613/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:31.642133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:31.762975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccb839-c10a-4e73-a6e6-c2c4e0b2d759 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.797472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.798101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.798380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.798826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.809653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.811088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:31.825927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:31.827238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:31.828347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:31.828347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:31.828347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:31.828347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 615/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:31.833351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:31.942389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ca674-2d29-4de2-a8e3-33cd8f958ba3 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:31.944911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:31.981522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:31.982121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:31.982392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:31.982657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:31.983291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:31.983614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:31.985139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:31.998928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 614/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:32.005305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:32.015902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:32.121580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572159-7a77-4e5d-bfda-921256653769 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:32.166827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:32.167597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:32.167904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:32.168186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:32.180739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:32.182239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:32.194517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:32.195765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:32.196861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 616/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:32.201833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:32.317434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33ccce-1053-4719-9b25-408d8e38e6eb None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:32.355188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:32.355880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:32.356212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:32.356564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:32.357386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:32.357772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:32.359486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d33d-cfb2-48a8-85ac-bc047b4e2350 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:32.372583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 615/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:32.379182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:32.450622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:32.490301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edf37a-ad68-4160-8f70-5405bbbda1fb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:32.523852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:32.524494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:32.524765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:32.525032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/2c853b65b78d44a8a5656c1b84b4bff5/roles/00b4de16079343dc809b6e65477e2d26` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:32.539706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=2c853b65b78d44a8a5656c1b84b4bff5, role_id=00b4de16079343dc809b6e65477e2d26)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:32.541262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8410fc3-85f0-4866-9f8d-89bd486c1622 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:32.555063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 617/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:28:32 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/2c853b65b78d44a8a5656c1b84b4bff5/roles/00b4de16079343dc809b6e65477e2d26 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:28:34.689173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846ca0-d49d-489d-aecc-431165690035 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:34.690222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846ca0-d49d-489d-aecc-431165690035 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:34.690222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846ca0-d49d-489d-aecc-431165690035 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:34.691595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 616/1233] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:28:34.696867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:34.697326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:34.697485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:34.717824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:34.719076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:34.790916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 618/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:35.078746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846ca0-d49d-489d-aecc-431165690035 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:35.106776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:35.197727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846ca0-d49d-489d-aecc-431165690035 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:35.234227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:35.234856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:35.235127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:35.235391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:35.246731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:35.251449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:35.252864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:35.254172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 617/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:35.259347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:35.310176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:35.371628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50f4f-97a3-47b5-ab23-ac4fa0c68f0b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:35.410646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:35.411280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:35.411644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:35.411915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:35.412635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:35.412996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:35.414613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:35.428424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 619/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:28:35.429725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:35.527047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:35.545008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0775ce-8ede-447e-bf02-47bace54dcd1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:35.585797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:35.586428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:35.586704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:35.586974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:35.600378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:35.601932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:35.624370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:35.625512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:35.626527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:35.626527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:35.626527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:35.626527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 618/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:35.631923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:35.743865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24954-e8c1-4b7d-82b7-7d27dc49b9ee None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:35.754713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:35.784904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:35.785698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:35.785998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:35.786467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:35.787112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:35.787419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:35.788914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:35.800963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 620/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:35.806807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:35.920444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb69706-7e5f-4c66-94eb-7fe25da691d1 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:35.956708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:35.957813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:35.958119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:35.958457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:35.962139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:35.967216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:35.969051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:35.981969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:35.983105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:35.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 619/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 08:28:35.989581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:36.105608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83f275-306a-4253-9897-a8f1f7d4b651 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:36.146638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:36.147383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:36.147770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:36.148033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:36.149005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:36.149406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:36.151079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:36.174778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 621/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:36.180428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:36.288201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674db7c-f2cd-46f8-8851-18c1c1fe6806 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:36.326664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:36.327268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:36.327628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:36.327834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:36.390532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:36.397406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:36.398814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:36.502296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 620/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:28:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:28:36.507942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:36.537774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:36.613938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc73c1-1ea2-44ba-a97f-9a30d5d35470 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:36.653082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:36.653771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:36.654053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:36.654326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:36.665403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:36.666836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:36.681692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:36.682728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:36.683672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:36.683672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:36.683672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:36.683672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 622/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:36.688639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:36.785436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:36.791667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cdd54-3e7d-4961-83fd-0a50c6724ceb None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:36.826739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:36.827385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:36.827636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:36.827903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:36.828541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:36.828856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:36.831075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:36.843012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 621/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:36.848720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:36.932561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:36.961134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba507-94a6-4951-8be6-5469b262b3bb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:36.997061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:36.997706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:36.997960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:36.998231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:37.005365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:37.006732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:37.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:37.019966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:37.021160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 623/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:37.026726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:37.138820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35006729-db45-4a40-aa6b-5117c34336dc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:37.181182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:37.181896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:37.182241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:37.182514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:37.183208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:37.183511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:37.185126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873968cb-e237-4549-81bf-ca7566431750 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:37.199965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 622/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:37.206799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:37.315896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc22a-b4ae-47f6-9455-0a0c3bead6f0 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:37.356938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:37.357541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:37.357818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:37.358089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:37.358835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] RBAC: Adding query filter params (role.id=00b4de16079343dc809b6e65477e2d26, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=2c853b65b78d44a8a5656c1b84b4bff5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:37.359187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:37.360730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9927a-821f-44ee-921d-684fea11f5fd None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:37.367062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 624/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:28:37 2022] GET /identity/v3/role_assignments?user.id=2c853b65b78d44a8a5656c1b84b4bff5&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=00b4de16079343dc809b6e65477e2d26 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:39.474347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46445f-cbdf-4f97-823a-0cd5df1cd9a2 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:39.474893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46445f-cbdf-4f97-823a-0cd5df1cd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:39.474893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46445f-cbdf-4f97-823a-0cd5df1cd9a2 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:39.476402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 623/1247] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:39.482098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:39.482556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:39.482648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:39.489096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:39.502634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:39.503909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:39.583589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 625/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:39.865556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46445f-cbdf-4f97-823a-0cd5df1cd9a2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:39.885208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:39.980007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46445f-cbdf-4f97-823a-0cd5df1cd9a2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.023297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.023962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.024242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.024516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.035091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:40.040268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:40.041523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:40.042398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 624/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:40.047646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:40.160330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca46152-15b2-4da8-81ca-252cce07f2af None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.195583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:40.201714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.202387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.202654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.202965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.203707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:40.204050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:40.205775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:40.216115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 626/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:40.223456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:40.310426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:40.334918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6cf4f-4eb0-4ddd-b13c-de1b52459e5f None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.374004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.374777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.375140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.375434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.388352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:40.389841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:40.407184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:40.408303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:40.409589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:40.409589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:40.409589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:40.409589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 625/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:40.414474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:40.520462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0e6f-73f0-4945-bae1-3d5377362da7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.555709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.556313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.556583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.556850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.557477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:40.557775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:40.559124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:40.571456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 627/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:40.577310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:40.684866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750419-56b1-4bf4-9864-e617c3d1e7e7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.712554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:40.722288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.722921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.723200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.723475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.731079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:40.732564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:40.744577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:40.745707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:40.746909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 626/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:40.753643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:40.812323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:40.857547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bfff8-14b6-409e-b388-24107f79a3db None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:40.895758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:40.896494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:40.896842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:40.897120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:40.897846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:40.898149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:40.899591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:40.922310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 628/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:40.923503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.026316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfa90-69d4-4fde-809a-096a5f6735b5 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:41.061008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:41.061977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:41.062288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:41.062624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:41.127282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:41.143368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:41.145073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:41.259031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 627/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:28:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:28:41.264872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.374001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687b650-e537-45b4-9f42-77b17ac7ca43 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:41.388054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:41.410505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:41.411127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:41.411398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:41.411697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:41.421942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:41.423291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:41.437855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:41.444178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:41.445368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:41.445368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:41.445368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:41.445368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 629/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:41.445670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.542121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:41.557950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d55ca-14ca-478a-998d-c903c26dd51b None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:41.597244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:41.597934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:41.598135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:41.598404 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:41.599060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:41.599363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:41.600781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:41.613455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 628/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:41.619327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.724140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff384-ca2a-47fc-9606-090751dbcaef None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:41.760848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:41.761504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:41.761776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:41.762043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:41.768880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:41.770333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:41.781927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:41.783018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:41.784573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 630/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:41.789127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.895834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a56d-deb1-4134-a84a-24e66c39eb0d None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:41.930762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:41.931382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:41.931697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:41.931972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:41.932672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:41.932976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:41.934531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dc497-8a03-49d2-a0c3-36f54c385300 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:41.947624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 629/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:41.953801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:41.981384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:42.061588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47db2-8023-40b6-a174-5b5cd6bc38d5 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:42.096090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:42.096689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:42.096964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:42.097235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:42.097945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=2c853b65b78d44a8a5656c1b84b4bff5) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:42.098248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:42.099684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393a42-1694-43d3-95f8-6e59583fc1ba None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:42.105087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 631/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:28:41 2022] GET /identity/v3/role_assignments?user.id=2c853b65b78d44a8a5656c1b84b4bff5&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:43.961119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5849d-dc9a-4021-a46c-9704267cdb4c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:43.961685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5849d-dc9a-4021-a46c-9704267cdb4c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:43.961685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5849d-dc9a-4021-a46c-9704267cdb4c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:43.962998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 630/1261] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:43.968138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:43.968540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:43.968686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:43.986827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:43.988043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:44.053136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 632/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:44.335336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5849d-dc9a-4021-a46c-9704267cdb4c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:44.346712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:44.434247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5849d-dc9a-4021-a46c-9704267cdb4c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:44.467441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:44.468081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:44.468357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:44.468623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:44.478393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:44.483061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:44.484213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:44.485245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 631/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:44.490153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:44.508186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:44.586035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47782421-ebd9-48f5-a8c6-fbe46b7ec1df None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:44.618526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:44.619118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:44.619394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:44.619696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:44.620344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:44.620639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:44.621978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:44.630285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 633/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:44.636082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:44.702549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:44.736483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6b1d-83eb-45ca-a270-684cc2b182a0 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:44.770095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:44.770707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:44.770986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:44.771256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:44.781111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:44.782632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:44.798415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:44.799596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:44.799596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:44.799596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:44.799596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 632/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:44.804150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:44.883099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:44.902109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503892c0-5b6c-4f2a-a558-a770941562b7 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:44.934323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:44.934914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:44.935191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:44.935464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:44.936128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:44.936430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:44.937775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:44.949044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 634/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:44.955402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.052585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef4cb-d206-4040-8be9-95c1e85beafc None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.072067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:45.086840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.087446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.087745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.088009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.095118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.096569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:45.107313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:45.108469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:45.109450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 633/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:45.114225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.219722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f0202-b334-4303-9cee-b005edc225c1 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.252065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.252664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.252936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.253199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.253912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:45.254213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.255644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.263884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:45.273332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 635/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:45.279127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.376933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367335-f52b-423b-84cf-c88bb4aa1176 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.409551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.410166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.410450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.410723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.420917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.422341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:45.436654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:45.437772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:45.438956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:45.438956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:45.438956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:45.438956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 634/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:45.444004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.539121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8212c-460b-441a-9f5b-1cb09f204800 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.572363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.572953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.573223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.573489 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.574115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:45.574410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.575779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.586795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 636/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:45.592425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.623791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:45.691249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f132-4f6b-47cd-a501-c1bcdde16602 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.722982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.723616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.723891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.724157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.730520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.731970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:45.743184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:45.744257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:45.745531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 635/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:45.750378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.806361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:45.847125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae0fb8-dd4a-4753-95ec-775785fae5fb None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:45.879450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:45.880058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:45.880333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:45.880601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:45.881269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:45.881566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:45.882971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a88a32-1367-4f8b-a8e6-1841ade1d96d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:45.894333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 637/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:45.900228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:45.989512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:45.998381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1738-e388-4050-be6f-38f96d4b85f7 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:46.029984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:46.030611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:46.030882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:46.031147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] PATH_INFO: `/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/2c853b65b78d44a8a5656c1b84b4bff5/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:46.033580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] RBAC: Authorizing `identity:create_grant(project_id=fad994fe60eb4c22958e0e687dd6bf93, user_id=2c853b65b78d44a8a5656c1b84b4bff5, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:46.034986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958484a-e2c0-4a52-94c3-14cc27fed84b None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:46.047845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 636/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 17 08:28:45 2022] PUT /identity/v3/projects/fad994fe60eb4c22958e0e687dd6bf93/users/2c853b65b78d44a8a5656c1b84b4bff5/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:28:47.908507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876037-57c7-46fd-802a-639c14f5b8d9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:47.909013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876037-57c7-46fd-802a-639c14f5b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:47.909106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876037-57c7-46fd-802a-639c14f5b8d9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:47.910381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 638/1274] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:47.915323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:47.915763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:47.915921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:47.933532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:47.934709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:47.999695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 637/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:48.270920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c876037-57c7-46fd-802a-639c14f5b8d9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:48.367392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c876037-57c7-46fd-802a-639c14f5b8d9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:48.385131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:48.402038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:48.402681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:48.402957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:48.403227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:48.412954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 08:28:48.417638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:48.418738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:48.419674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 639/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 17 08:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:48.425042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:48.503208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:48.521552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb447b-63db-4c47-a432-6d6f45b72ac0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:48.554094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:48.554687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:48.554964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:48.555234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:48.555921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:48.556226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:48.557581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:48.565864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 638/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 17 08:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:48.571373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:48.667816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda5fa8-5130-4817-bdd0-a2da3b12a24c None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:48.699075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:48.699712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:48.699986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:48.700251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:48.710996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:48.712430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:48.726403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:48.727744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:48.728939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:48.728939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:48.728939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:48.728939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 640/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:48.733283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:48.831255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867668d-c47e-4cc0-852b-c63c95a73d7c None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:48.863390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:48.864017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:48.864293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:48.864561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:48.865190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:48.865488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:48.866844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:48.878558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 639/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:48.883955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:48.914055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:48.980309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493abfbc-26de-4f19-8c5e-fa2bca5c2e0f None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.012639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.013252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.013529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.013799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.021566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.022990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 08:28:49.033887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:49.035011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:49.036231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 641/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:49.040597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:49.044390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:49.138738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d600e-4086-46ae-88d8-58576c0abe56 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.171747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.172337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.172617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.172891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.174144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:49.174450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.175884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.192929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 640/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:49.198428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:49.285784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:49.295679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74086944-f679-4308-8d52-debe6954ef2d None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.328777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.329761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.330042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.330343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.395202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.396606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.480946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:49.494598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 642/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 08:28:49.499359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:49.559954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:49.599316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2cde4-56ce-44ff-a6f6-10efdb5c6de6 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.633413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.634029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.634306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.634576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.644884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.646364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 08:28:49.660441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:49.661479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 08:28:49.662691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 08:28:49.662691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 08:28:49.662691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:49.662691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 641/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:49.667222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:49.764390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97deba-d293-4250-936d-d7df86c884bf None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.801919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.802513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.802791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.803070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.803733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:49.804037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.805395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.816718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 643/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:49.822281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:49.919497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74bace-3632-4e79-9f24-8393ccc30e96 None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:49.933037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:49.953347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:49.953954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:49.954500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:49.954805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:49.961274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:49.962720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 08:28:49.973658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:49.974687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: ERROR keystone.server.flask.application Aug 17 08:28:49.975657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 642/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:49.980378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:50.028857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:50.077531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b5e5c-94a2-458d-b085-556c8e6237ea None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:50.109479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:50.110064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:50.110340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:50.111136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:50.111845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:50.112148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:50.113555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f90f6-819e-4cf1-a53b-e4f5ab5e137f None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:50.124988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 644/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 17 08:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:50.131497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:50.226958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e0a4b-3454-4565-afe9-ae58e8799cce None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:50.259481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:50.260089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:50.260364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:50.260634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:50.261347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] RBAC: Adding query filter params (role.id=4a7c9bba983f483f9f1d305a364e0521, scope.project.id=fad994fe60eb4c22958e0e687dd6bf93, user.id=2c853b65b78d44a8a5656c1b84b4bff5) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:50.261650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:50.263053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc60ba-72e1-458c-8fd9-57aae66ee3fc None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:50.268590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 643/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 17 08:28:50 2022] GET /identity/v3/role_assignments?user.id=2c853b65b78d44a8a5656c1b84b4bff5&scope.project.id=fad994fe60eb4c22958e0e687dd6bf93&role.id=4a7c9bba983f483f9f1d305a364e0521 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:52.145773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f44d7-93c8-4246-b17f-676b4dd12f71 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:52.146333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f44d7-93c8-4246-b17f-676b4dd12f71 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:52.146333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f44d7-93c8-4246-b17f-676b4dd12f71 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:52.147667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 645/1288] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:52.152745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:52.153163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:52.153268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:52.171251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:52.172449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:52.201113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:52.237449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 644/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:52.499291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f44d7-93c8-4246-b17f-676b4dd12f71 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:52.597535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f44d7-93c8-4246-b17f-676b4dd12f71 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:52.607942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:52.630733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:52.631345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:52.631648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:52.631918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:52.632492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:52.633830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:52.642825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:52.644084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:52.645166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:52.647708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 646/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:28:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:52.649726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:52.744314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e5b6f-6206-40d0-8684-26aaa7e30a78 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:52.777433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:52.777965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:52.778250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:52.778522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:52.779143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:52.779445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:52.780834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4030e-baa2-4186-bfbf-6bd1aaa55905 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:52.785484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 645/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 17 08:28:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:52.790836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:52.886763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbfa05-281f-4b78-beee-32666600dd96 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:52.918709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:52.919294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:52.919588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:52.919860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] PATH_INFO: `/v3/services` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:52.920470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:52.920764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:52.922097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4826d8-3da1-411d-bc4e-95674772ad42 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:52.926774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 647/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 17 08:28:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:54.757091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77fd5-00fe-4ff6-b76e-50248cf05e86 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:54.757715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77fd5-00fe-4ff6-b76e-50248cf05e86 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:54.757715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77fd5-00fe-4ff6-b76e-50248cf05e86 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:54.758956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 646/1293] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:54.763927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf9b1-705c-4334-8860-bf582dde3547 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:54.764323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf9b1-705c-4334-8860-bf582dde3547 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:54.764470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdf9b1-705c-4334-8860-bf582dde3547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:54.782164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-67bdf9b1-705c-4334-8860-bf582dde3547 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:54.783344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-67bdf9b1-705c-4334-8860-bf582dde3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:54.812107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:54.848747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 648/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:55.113459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77fd5-00fe-4ff6-b76e-50248cf05e86 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:55.146572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:55.217562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77fd5-00fe-4ff6-b76e-50248cf05e86 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:55.250891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:55.251480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:55.251778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:55.252045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:55.252684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:55.254108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7264c-4014-4f35-a813-214a72a69910 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:55.267898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 647/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 17 08:28:55 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:28:57.119454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd7e1-b776-4151-b729-045d241df986 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:57.120045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd7e1-b776-4151-b729-045d241df986 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:57.120045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd7e1-b776-4151-b729-045d241df986 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:57.121377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 649/1296] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:57.126643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:57.127212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:57.127212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:57.145022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:57.146197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:28:57.216238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 648/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:28:57.478497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dd7e1-b776-4151-b729-045d241df986 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:57.575510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dd7e1-b776-4151-b729-045d241df986 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:57.609058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:57.609685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:57.609965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:57.610739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:57.611317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:57.612718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:28:57.621300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:28:57.623823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:28:57.624999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 650/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:28:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:28:57.628788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:57.646719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:57.726513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b590-8f61-475c-953d-b3f84f340b39 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:57.759818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:57.760351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:57.760631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:57.760901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:57.761518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] RBAC: Adding query filter params (name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:57.761816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:57.763171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:57.768169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 649/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 17 08:28:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:28:57.774053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:57.804957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:57.877784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e94a-85d8-44dc-a697-c4d65ba292e9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:57.910105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:57.910700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:57.910978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:57.911247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:57.911970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] RBAC: Adding query filter params (interface=public, service_id=950404b512e34770805f5d4089d56e3e, region_id=RegionOne) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:28:57.912283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:57.913633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704b4f1-d55d-4f45-96cc-e47140aa79f8 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:57.918425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 651/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 17 08:28:57 2022] GET /identity/v3/endpoints?service_id=950404b512e34770805f5d4089d56e3e&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:28:57.924775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:28:58.004051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:28:58.021867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1f452-85f1-4947-b3f1-8ab0429f5fae None admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:28:58.054231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:28:58.054817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:58.055091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:58.055359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:58.055982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:28:58.057322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb2bb-9b68-40de-b9bc-d15a2156b89a None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:28:58.063886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 650/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 17 08:28:57 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:28:59.958737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa653-4a33-442b-9a0b-686c4779e741 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:59.959252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa653-4a33-442b-9a0b-686c4779e741 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:59.959252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa653-4a33-442b-9a0b-686c4779e741 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:59.960673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 652/1302] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:28:59.965711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:28:59.966130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:28:59.966258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:28:59.983858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:28:59.985557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:29:00.049767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 651/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:28:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 08:29:00.321302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa653-4a33-442b-9a0b-686c4779e741 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:29:00.413465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:29:00.420610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa653-4a33-442b-9a0b-686c4779e741 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:29:00.453267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:29:00.453878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:29:00.454413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:29:00.454753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:29:00.455328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:29:00.456709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 08:29:00.465165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 08:29:00.466340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application with Lock( Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self._enter() Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application return self.creator() Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application created_value = creator( Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: ERROR keystone.server.flask.application Aug 17 08:29:00.467623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 653/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 17 08:29:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 08:29:00.472108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:29:00.545695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:29:00.569182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052965c3-ba15-41ec-a68e-25150bf343ab None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:29:00.601765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:29:00.602299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:29:00.602582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:29:00.602855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] PATH_INFO: `/v3/services` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:29:00.603490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:29:00.603821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:29:00.605182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368cdd-00c2-408f-83f5-7a38783b9419 None admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:29:00.610799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 652/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 17 08:29:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:29:00.616512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:29:00.712690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af10d-4557-4c6c-8ad8-5913242c7ea9 None admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:29:00.745099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:29:00.745679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:29:00.745953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:29:00.746222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:29:00.746865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:29:00.748229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19833b6f-8583-4c21-a4eb-67cef27c2043 None admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:29:00.767315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 654/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:29:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:29:10.607392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=30 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:29:10.763016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:03.342853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10d82-1c5b-491b-80b3-f654a62bb1b0 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:03.343974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10d82-1c5b-491b-80b3-f654a62bb1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:03.344488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af10d82-1c5b-491b-80b3-f654a62bb1b0 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:03.349595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 653/1307] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:03.351312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c97bc-f539-419d-ba51-1d03d3d9517e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:03.352157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c97bc-f539-419d-ba51-1d03d3d9517e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:03.352631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c97bc-f539-419d-ba51-1d03d3d9517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:03.440665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-325c97bc-f539-419d-ba51-1d03d3d9517e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:03.442380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-325c97bc-f539-419d-ba51-1d03d3d9517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:03.709466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 655/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:04.005483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:04.005850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:04.006232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:04.007668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 654/1309] 10.222.0.15 () {54 vars in 965 bytes} [Wed Aug 17 08:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:04.014850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cd19-e6b3-4558-8265-f68442c70ea7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:04.015502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cd19-e6b3-4558-8265-f68442c70ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:04.015883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cd19-e6b3-4558-8265-f68442c70ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:04.104132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-86c3cd19-e6b3-4558-8265-f68442c70ea7 None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:04.105373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-86c3cd19-e6b3-4558-8265-f68442c70ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:04.129389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:04.192243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 656/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Aug 17 08:30:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:04.201770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:04.203803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:04.322229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374924f-8872-4fed-9f10-fb11dcf03c42 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:04.401254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:04.401913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:04.402180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:04.402399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:04.404026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:04.463209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:04.521287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:04.522711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf5309-5127-4d7b-a762-a555a8c6039b service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:04.542182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 655/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:06.781025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:06.781560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:06.781560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:06.782916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 657/1312] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:06.788410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ad1c-0a47-4794-b685-07447dfa5f2c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:06.788939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ad1c-0a47-4794-b685-07447dfa5f2c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:06.788939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70ad1c-0a47-4794-b685-07447dfa5f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:06.865676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9f70ad1c-0a47-4794-b685-07447dfa5f2c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:06.866892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9f70ad1c-0a47-4794-b685-07447dfa5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:06.989147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 656/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:07.272730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:07.274236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:07.378986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac73da-8411-4bd1-b561-a50e19006e8b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:07.448465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:07.451385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:07.452227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:07.453226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:07.453680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:07.455266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:07.561389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:07.562794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577cd32-65a4-4e05-a11f-7db4bb0674e0 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:07.581429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 658/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:09.757415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:09.757961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:09.757961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:09.759296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 657/1315] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:09.764427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686199-de48-4723-a0f2-58aa5dac2180 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:09.764798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686199-de48-4723-a0f2-58aa5dac2180 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:09.764977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686199-de48-4723-a0f2-58aa5dac2180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:09.830031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-da686199-de48-4723-a0f2-58aa5dac2180 None None] MFA Rules not processed for user `00c756b5256046849a97e0014acf510b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:09.831217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-da686199-de48-4723-a0f2-58aa5dac2180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:09.881086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:09.924833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 659/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:10.204890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:10.206489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:10.216307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:10.312631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847514e-e0e0-4317-b000-fb41ec0ed9e5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:10.384915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:10.385514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:10.385791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:10.386052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:10.387662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:10.448896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:10.495830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:10.497247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8734b68-9db7-45d4-8e19-d968b9c20760 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:10.516136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 658/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:12.969725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:12.970237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:12.970237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:12.971763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 660/1318] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:12.976616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe260-2a1b-4873-8616-606c35299bb2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:12.977010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe260-2a1b-4873-8616-606c35299bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:12.977171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe260-2a1b-4873-8616-606c35299bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:13.044578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-429fe260-2a1b-4873-8616-606c35299bb2 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:13.045721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-429fe260-2a1b-4873-8616-606c35299bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:13.144516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 659/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:13.431728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:13.433250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:13.535347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe0e36-c8ca-47bd-8014-a49e05c87914 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:13.606929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:13.607783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:13.607880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:13.608074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:13.609654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:13.617007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:13.716854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:13.718194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698136e-d1eb-4fa6-bcb2-a6578b9d06ef service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:13.736825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 661/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:16.287860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:16.288400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:16.288653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:16.290089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 660/1321] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:16.296261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3fe9-b0c2-45b7-a4b8-b8c56b844a92 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:16.296709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3fe9-b0c2-45b7-a4b8-b8c56b844a92 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:16.296803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3fe9-b0c2-45b7-a4b8-b8c56b844a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:16.362393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f0af3fe9-b0c2-45b7-a4b8-b8c56b844a92 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:16.363617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f0af3fe9-b0c2-45b7-a4b8-b8c56b844a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:16.420583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:16.460433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 662/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:16.744071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:16.745648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:16.765827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:16.852818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df83c90-86d3-4b7a-a673-8ebe3960e637 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:16.928364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:16.928903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:16.929182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:16.929452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:16.931102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:17.005137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:17.044325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:17.045790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8639-6277-41a9-9d99-b853d3e67fb8 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:17.064591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 661/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:19.036024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:19.036531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:19.036531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:19.037998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 663/1324] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:19.043337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c6f4-e67b-44ef-8a94-48249093511a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:19.043809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c6f4-e67b-44ef-8a94-48249093511a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:19.043917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c6f4-e67b-44ef-8a94-48249093511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:19.114473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8e47c6f4-e67b-44ef-8a94-48249093511a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:19.115710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8e47c6f4-e67b-44ef-8a94-48249093511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:19.214352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 662/1325] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:30:19.498990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:19.500695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:19.614124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0636ea7-84a6-4235-8f3c-38fa0a1cbf26 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:19.688608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:19.689214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:19.689486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:19.689752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:19.692340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:19.709818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:19.801194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:19.802613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcd202-6549-42fb-9fc7-f3f30e49d12a service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:19.820152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 664/1326] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:21.769548 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387ce-4f3c-434a-b3dc-b37e9caca47e None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:21.770094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387ce-4f3c-434a-b3dc-b37e9caca47e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:21.770094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387ce-4f3c-434a-b3dc-b37e9caca47e None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:21.771462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 663/1327] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:21.777218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b285-ced9-4fe6-ac77-41bbc9c1633b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:21.777776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b285-ced9-4fe6-ac77-41bbc9c1633b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:21.777776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78b285-ced9-4fe6-ac77-41bbc9c1633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:21.848320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6f78b285-ced9-4fe6-ac77-41bbc9c1633b None None] MFA Rules not processed for user `00c756b5256046849a97e0014acf510b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:21.849520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6f78b285-ced9-4fe6-ac77-41bbc9c1633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:21.915831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:21.949009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 665/1328] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:30:22.244853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:22.245136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:22.245403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:22.246787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 664/1329] 10.222.0.15 () {54 vars in 965 bytes} [Wed Aug 17 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:22.253350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db93c7-666a-4507-a14a-073238b0fd25 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:22.253637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db93c7-666a-4507-a14a-073238b0fd25 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:22.253914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db93c7-666a-4507-a14a-073238b0fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:22.332025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-00db93c7-666a-4507-a14a-073238b0fd25 None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:22.333227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-00db93c7-666a-4507-a14a-073238b0fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:22.410205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 666/1330] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Aug 17 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:22.420170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:22.421689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:22.453530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:22.527712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aefc44-7627-40ff-bf54-3c1423d82aa7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:22.603488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:22.604121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:22.604398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:22.604668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:22.606317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:22.683198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:22.716918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:22.718282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f5220-979c-4286-8c30-0209dea76386 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:22.736102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 665/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:25.283051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:25.283652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:25.283652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:25.284965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 667/1332] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:25.289957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255b97-549e-4271-827a-a598d02bbd50 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:25.290349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255b97-549e-4271-827a-a598d02bbd50 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:25.290501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255b97-549e-4271-827a-a598d02bbd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:25.356452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-eb255b97-549e-4271-827a-a598d02bbd50 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:25.357593 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eb255b97-549e-4271-827a-a598d02bbd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:25.452212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 666/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:25.737722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:25.739240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:25.808005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:25.842576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b1a5-95c8-43ca-8a4b-3d4c9c992891 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:25.913767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:25.914375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:25.914648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:25.914916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:25.916527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:26.024088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:26.025500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9770cd-26bb-4c20-af80-70f8218d45a8 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:26.035200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:26.044147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 668/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:27.977642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:27.978229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:27.978229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:27.979531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 667/1335] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:27.986111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc524df-f334-42a8-a82f-f399e524b59b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:27.986571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc524df-f334-42a8-a82f-f399e524b59b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:27.986684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc524df-f334-42a8-a82f-f399e524b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:28.057543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bfc524df-f334-42a8-a82f-f399e524b59b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:28.058761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bfc524df-f334-42a8-a82f-f399e524b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:28.167092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 669/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:28.452772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:28.454309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:28.495247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:28.562092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f9e93-fb28-4906-a21f-d54a87d6d9f9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:28.639666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:28.640280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:28.640559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:28.640829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:28.642436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:28.732420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:28.759669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:28.761106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012136b-8d1b-4f22-a74a-9b214f63e239 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:28.779563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 668/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:31.086576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:31.087023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:31.087151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:31.088480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 670/1338] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:31.094331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecadef8-eece-4c79-ab43-63eed4068e00 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:31.094762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecadef8-eece-4c79-ab43-63eed4068e00 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:31.094901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecadef8-eece-4c79-ab43-63eed4068e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:31.163834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0ecadef8-eece-4c79-ab43-63eed4068e00 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:31.165060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ecadef8-eece-4c79-ab43-63eed4068e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:31.265625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 669/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:31.547914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:31.549435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:31.628823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:31.658414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc168-0264-47ee-98ca-fde7faafd661 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:31.733841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:31.734443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:31.734726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:31.734996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:31.736646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:31.848477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:31.849834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71360f8b-4f10-4064-864e-29ccb29ef0be service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:31.869610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 671/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:35.814021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:35.814426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:35.814571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:35.816104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 670/1341] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:35.821219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72d29-bbc7-4ff2-965c-15fae647d1ab None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:35.821643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72d29-bbc7-4ff2-965c-15fae647d1ab None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:35.821747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72d29-bbc7-4ff2-965c-15fae647d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:35.828031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:35.890183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0af72d29-bbc7-4ff2-965c-15fae647d1ab None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:35.891402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0af72d29-bbc7-4ff2-965c-15fae647d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:35.985944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 672/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:36.271665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:36.273219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:36.322247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:36.378989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b19d3-2aaa-4b3e-9120-a98972000762 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:36.453375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:36.453975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:36.454249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:36.454516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:36.456118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:36.551689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:36.568755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:36.570188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2495d0-8f44-4ae8-8b25-2516d155275e service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:36.591278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 671/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:39.194730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:39.195297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:39.195297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:39.196646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 673/1344] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:39.203344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4cd0-b883-4a29-b543-f7d973738b8a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:39.203344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4cd0-b883-4a29-b543-f7d973738b8a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:39.203795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4cd0-b883-4a29-b543-f7d973738b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:39.270796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-88de4cd0-b883-4a29-b543-f7d973738b8a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:39.272039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-88de4cd0-b883-4a29-b543-f7d973738b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:39.369230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 672/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:39.654485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:39.656099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:39.741151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:39.757919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eaa66-f599-45b7-96ab-4401de0bb00b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:39.831226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:39.831868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:39.832142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:39.832407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:39.833979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:39.944750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:39.946127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429da54-fe6b-407e-955e-7e4925ef5630 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:39.964371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 674/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:43.823026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:43.823617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:43.823617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:43.825175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 673/1347] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:43.831090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415dd2-ed8d-49e8-92fc-71482c4c6dfa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:43.831561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415dd2-ed8d-49e8-92fc-71482c4c6dfa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:43.831698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415dd2-ed8d-49e8-92fc-71482c4c6dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:43.847433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:43.922076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-99415dd2-ed8d-49e8-92fc-71482c4c6dfa None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:43.923287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-99415dd2-ed8d-49e8-92fc-71482c4c6dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:44.028414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 675/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:44.307328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:44.308911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:44.375843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:44.425572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0a5a6-a510-49bb-a04a-450bd3ba0988 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:44.499463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:30:44.500103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:44.500376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:44.500641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:44.502234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:44.611044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:44.615012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:30:44.616471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09489762-9dd6-425c-94ac-287246cad734 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:30:44.634645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 674/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:30:49.536954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5096b-f23f-43ce-aeca-e04485b4f105 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:49.537392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5096b-f23f-43ce-aeca-e04485b4f105 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:49.537508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5096b-f23f-43ce-aeca-e04485b4f105 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:49.539181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 676/1350] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:49.545230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064aac0-343b-45ab-97db-d861e9dca5fd None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:49.545651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064aac0-343b-45ab-97db-d861e9dca5fd None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:49.545824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064aac0-343b-45ab-97db-d861e9dca5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:49.672441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2064aac0-343b-45ab-97db-d861e9dca5fd None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:49.674218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2064aac0-343b-45ab-97db-d861e9dca5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:49.794094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 675/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:53.942595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f4d7-5f1b-46e4-b24f-6273774f8c35 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:53.943523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f4d7-5f1b-46e4-b24f-6273774f8c35 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:53.943944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f4d7-5f1b-46e4-b24f-6273774f8c35 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:53.945350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 677/1352] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:53.950780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beeaed-31b7-4b00-b917-efddd2307106 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:53.951489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beeaed-31b7-4b00-b917-efddd2307106 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:53.951715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beeaed-31b7-4b00-b917-efddd2307106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:54.008091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:54.025698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=59 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:54.033612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d7beeaed-31b7-4b00-b917-efddd2307106 None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:54.034870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d7beeaed-31b7-4b00-b917-efddd2307106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:54.153794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 676/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:55.466810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d10f4-85b9-4a95-a988-e26a14287430 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:55.467344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d10f4-85b9-4a95-a988-e26a14287430 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:55.467438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d10f4-85b9-4a95-a988-e26a14287430 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:55.468949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 678/1354] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:55.474115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac28d-9bfe-412b-a2b3-a2fe02eced6f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:55.474541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac28d-9bfe-412b-a2b3-a2fe02eced6f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:55.474676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bac28d-9bfe-412b-a2b3-a2fe02eced6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:55.552074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-90bac28d-9bfe-412b-a2b3-a2fe02eced6f None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:55.553389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-90bac28d-9bfe-412b-a2b3-a2fe02eced6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:55.596526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:55.661851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 677/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:30:58.947392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab95-f618-455a-a52d-cbcdb7cf9f62 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:58.948046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab95-f618-455a-a52d-cbcdb7cf9f62 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:58.948046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab95-f618-455a-a52d-cbcdb7cf9f62 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:58.951752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 679/1356] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:58.955395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db702ee-fe6b-4579-9b18-aa9f7cac7867 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:58.955883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db702ee-fe6b-4579-9b18-aa9f7cac7867 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:58.955988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db702ee-fe6b-4579-9b18-aa9f7cac7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:59.039286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1db702ee-fe6b-4579-9b18-aa9f7cac7867 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:59.041948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1db702ee-fe6b-4579-9b18-aa9f7cac7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:59.172301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 678/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:59.472741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:59.473456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:59.473941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:59.475768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 680/1358] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 17 08:30:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:30:59.484910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba8a06-4abb-4343-8e36-dc7eaee47ebf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:30:59.485762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba8a06-4abb-4343-8e36-dc7eaee47ebf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:30:59.486267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba8a06-4abb-4343-8e36-dc7eaee47ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:30:59.507817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:59.569344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8eba8a06-4abb-4343-8e36-dc7eaee47ebf None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:30:59.570688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8eba8a06-4abb-4343-8e36-dc7eaee47ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:59.717990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 679/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 17 08:30:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:30:59.726468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:30:59.728319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:30:59.884423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de6eae-79b4-4cfb-8913-6db7c11aea14 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:30:59.961467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:00.003176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:00.004041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:00.004476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:00.004901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:00.006625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:00.100258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:00.101942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7909c31-6107-4cee-854c-a75b4b654b5e service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:00.120437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 681/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:02.249686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:02.250210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:02.250210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:02.254698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 680/1361] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:02.256622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85eaf9-edb6-4647-aaa7-0c57b4ca28a0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:02.257051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85eaf9-edb6-4647-aaa7-0c57b4ca28a0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:02.257154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85eaf9-edb6-4647-aaa7-0c57b4ca28a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:02.327691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bc85eaf9-edb6-4647-aaa7-0c57b4ca28a0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:02.329145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bc85eaf9-edb6-4647-aaa7-0c57b4ca28a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:02.370259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:02.444915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 682/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:02.740238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:02.741945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:02.813328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:02.899887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf872d9-31b8-4dcb-bedf-eb50afcb5c90 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:03.039819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:03.040746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:03.041626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:03.042021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:03.043963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:03.070889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:03.151650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:03.153483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a796d9d-bd62-4c8a-9a7b-d22c5c9c5088 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:03.175677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 681/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:05.404325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8b09-9bad-4a4e-9513-3a37e792b026 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:05.404889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8b09-9bad-4a4e-9513-3a37e792b026 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:05.404889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8b09-9bad-4a4e-9513-3a37e792b026 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:05.406198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 683/1364] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:05.411504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289685ed-3bf7-410b-aa8c-21249323a8af None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:05.411954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289685ed-3bf7-410b-aa8c-21249323a8af None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:05.412281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289685ed-3bf7-410b-aa8c-21249323a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:05.483156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-289685ed-3bf7-410b-aa8c-21249323a8af None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:05.484387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-289685ed-3bf7-410b-aa8c-21249323a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:05.586105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:05.596619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 682/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:05.881800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:05.881985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:05.882446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:05.886973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 684/1366] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 17 08:31:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:05.893712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03cd50-e1c9-4324-9ef7-4c8039d54d5e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:05.894375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03cd50-e1c9-4324-9ef7-4c8039d54d5e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:05.894748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03cd50-e1c9-4324-9ef7-4c8039d54d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:05.987355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8c03cd50-e1c9-4324-9ef7-4c8039d54d5e None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:05.988768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8c03cd50-e1c9-4324-9ef7-4c8039d54d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:06.133342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 683/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 17 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:06.142754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:06.144465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:06.299678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39f8c2-ee57-41f6-89f2-a04ba4738d5a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:06.320241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:06.421506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:06.422207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:06.422592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:06.423105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:06.424955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:06.523914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:06.525520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e422f-6935-43af-971b-3f311d8e4bc6 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:06.544202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 685/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:31:07.026485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e72b7-3582-4cff-bfa2-dbc15424b9da None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:07.027040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e72b7-3582-4cff-bfa2-dbc15424b9da None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:07.027040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e72b7-3582-4cff-bfa2-dbc15424b9da None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:07.028620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 684/1369] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:07.033516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f3ee-6b01-426a-8767-3953932ea2cb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:07.033805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f3ee-6b01-426a-8767-3953932ea2cb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:07.034078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0f3ee-6b01-426a-8767-3953932ea2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:07.070739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:07.109541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-50e0f3ee-6b01-426a-8767-3953932ea2cb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:07.110972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-50e0f3ee-6b01-426a-8767-3953932ea2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:07.219585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 686/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:07.799752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:07.799752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:07.799752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:07.802649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 685/1371] 10.222.0.15 () {54 vars in 964 bytes} [Wed Aug 17 08:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:07.805650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47715b-4f24-4ea0-ab94-36965897ec06 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:07.806127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47715b-4f24-4ea0-ab94-36965897ec06 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:07.806289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47715b-4f24-4ea0-ab94-36965897ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:07.885386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4f47715b-4f24-4ea0-ab94-36965897ec06 None None] MFA Rules not processed for user `4d70f0f7e72a4d658218f9c8fcf64737`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:07.886596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4f47715b-4f24-4ea0-ab94-36965897ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:07.936886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:07.971693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 687/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Aug 17 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:07.977834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:07.979380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:08.032200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:08.092536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf818-358f-4f87-9a87-f6af5dab7ab6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:08.171737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:08.172382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:08.172628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:08.173102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:08.174773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:08.297649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:08.318355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:08.320505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1891b7a-2213-4d91-b1d4-76b3090bce92 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:08.348245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 686/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:31:08.520961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:08.521247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:08.521519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:08.523313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 688/1374] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:08.528992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d50614-e2c6-4494-96b6-9fbfb8279c36 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:08.529448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d50614-e2c6-4494-96b6-9fbfb8279c36 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:08.529715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d50614-e2c6-4494-96b6-9fbfb8279c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:08.598296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-39d50614-e2c6-4494-96b6-9fbfb8279c36 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:08.599515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-39d50614-e2c6-4494-96b6-9fbfb8279c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:08.695728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 687/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:08.985735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:08.987272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:09.144302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740873f5-681e-4ae8-856f-6a60f10d8113 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:09.195460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:09.257470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:09.257998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:09.258270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:09.258537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:09.260721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:09.351813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:09.353419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c815d-a440-424d-9e1a-633c19ce181f service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:09.371582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 689/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:11.288171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:11.288654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:11.288654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:11.289978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 688/1377] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:11.295669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a86f-8d75-4908-a1fc-64ba1a7af942 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:11.296076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a86f-8d75-4908-a1fc-64ba1a7af942 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:11.296228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a86f-8d75-4908-a1fc-64ba1a7af942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:11.365547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0ab2a86f-8d75-4908-a1fc-64ba1a7af942 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:11.366767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0ab2a86f-8d75-4908-a1fc-64ba1a7af942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:11.373385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:11.484148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 690/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:11.788517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:11.790091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:11.874742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:11.982079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896c0b-7c2a-4319-8589-7368a83eec5f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:12.104413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:12.105124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:12.105467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:12.105799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:12.107432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:12.126913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:12.205444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:12.207178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845bc4e-c40c-4c8c-addd-4797b1e03492 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:12.226848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 689/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:14.145347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:14.145857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:14.145977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:14.147607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 691/1380] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:14.153196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514580-7a31-416a-9691-66219376dfcb None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:14.153637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514580-7a31-416a-9691-66219376dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:14.153724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514580-7a31-416a-9691-66219376dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:14.231298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-22514580-7a31-416a-9691-66219376dfcb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:14.232620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-22514580-7a31-416a-9691-66219376dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:14.330257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:14.339607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 690/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:14.627864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:14.629619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:14.784978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:14.796524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679dbdc-ca87-4c5f-b6bb-8c7c5d98ab55 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:14.920494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:14.921106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:14.921386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:14.921658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:14.923701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:15.027135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:15.028850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890888b-d18e-4102-8d25-f06fdde4c485 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:15.039999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:15.050793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 692/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:17.588015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:17.588592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:17.588592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:17.589932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 691/1383] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:17.595843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a237-38be-4fd6-8536-e69723ecbab1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:17.596334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a237-38be-4fd6-8536-e69723ecbab1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:17.596435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a237-38be-4fd6-8536-e69723ecbab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:17.670305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3c51a237-38be-4fd6-8536-e69723ecbab1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:17.672197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3c51a237-38be-4fd6-8536-e69723ecbab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:17.805048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 693/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:18.095299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:18.096980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:18.246988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55034604-9a21-44bb-bffe-fe11681d1cb8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:18.313785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:18.366681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:18.367342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:18.367723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:18.368309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:18.370432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:18.466937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:18.468655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088846cb-2209-42ac-8356-78d0a3cb52c6 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:18.488758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 692/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:20.397193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:20.397929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:20.397929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:20.399044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 694/1386] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:20.404945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b658-3a32-451a-9cb7-c8d665d27bc4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:20.405490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b658-3a32-451a-9cb7-c8d665d27bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:20.405490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b658-3a32-451a-9cb7-c8d665d27bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:20.486814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c3e5b658-3a32-451a-9cb7-c8d665d27bc4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:20.488857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c3e5b658-3a32-451a-9cb7-c8d665d27bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:20.533861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:20.609122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 693/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:20.903830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:20.905460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:20.991971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:21.071021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4b26f-5cf2-4b39-8665-ffb3678f5904 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:21.226727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:21.227705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:21.227989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:21.228293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:21.229835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:21.270256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:21.324981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:21.326955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0f49-bd16-49b6-a4c6-33a594dbf880 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:21.345508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 695/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:23.290870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c24ab-3670-45ec-8594-11cb7a8a7195 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.291470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c24ab-3670-45ec-8594-11cb7a8a7195 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.291470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c24ab-3670-45ec-8594-11cb7a8a7195 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.292763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 694/1389] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:23.297019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8640-8fb3-4f91-93a0-93ce85778634 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.297457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8640-8fb3-4f91-93a0-93ce85778634 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.297550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8640-8fb3-4f91-93a0-93ce85778634 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.297675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851c94-46a6-4f71-a722-5ecd3dddebca None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.297953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851c94-46a6-4f71-a722-5ecd3dddebca None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.298223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851c94-46a6-4f71-a722-5ecd3dddebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.299035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 696/1390] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:23.303936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31923-d563-4522-bb82-6241b7319018 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.304216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31923-d563-4522-bb82-6241b7319018 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.304488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31923-d563-4522-bb82-6241b7319018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.380423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f8e31923-d563-4522-bb82-6241b7319018 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:23.381588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f8e31923-d563-4522-bb82-6241b7319018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:23.482055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-72851c94-46a6-4f71-a722-5ecd3dddebca None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:23.483277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-72851c94-46a6-4f71-a722-5ecd3dddebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:23.485560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 697/1391] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:31:23.582987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 695/1392] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:31:23.784184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.784469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.784742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.786069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 698/1393] 10.222.0.15 () {54 vars in 967 bytes} [Wed Aug 17 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:23.790958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:23.791244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:23.791514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:23.808303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:23.868540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] MFA Rules not processed for user `c633e39c46f94f608a0887fe25312310`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:23.869742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:23.871985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:23.873578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:23.887517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:23.947013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 696/1394] 10.222.0.15 () {58 vars in 1064 bytes} [Wed Aug 17 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:23.954986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:23.962532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e8b60-fef7-4f4e-8693-d497b2e78cb9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:24.020502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a04d9f-e6cf-4302-9cef-7d3fb086c792 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:24.036310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:24.036943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:24.037224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:24.037495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:24.039128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:24.070169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:24.107167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:24.134524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:24.135119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:24.135392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:24.135709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:24.137611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:24.153940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:24.155366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06f20-6ee3-42d6-9e3c-d6becf400305 service glance] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:24.175019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 697/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:31:24.226079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:24.228209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adc8eb-ba39-4966-9fed-d9423898c39c service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:24.246244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 699/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:31:24.909170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b92b8-8174-4121-815c-c714872c868d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:24.909610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b92b8-8174-4121-815c-c714872c868d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:24.909850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b92b8-8174-4121-815c-c714872c868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:24.977913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-cb5b92b8-8174-4121-815c-c714872c868d None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:24.979119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cb5b92b8-8174-4121-815c-c714872c868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:25.059452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:25.066474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 698/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:31:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:25.117173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:25.118257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:25.118660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:25.120240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 700/1398] 10.222.0.15 () {54 vars in 943 bytes} [Wed Aug 17 08:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:25.126827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16db1-f0cd-416a-980c-0970ac3e44ea None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:25.127110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16db1-f0cd-416a-980c-0970ac3e44ea None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:25.127383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16db1-f0cd-416a-980c-0970ac3e44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:25.204118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b1a16db1-f0cd-416a-980c-0970ac3e44ea None None] MFA Rules not processed for user `5dccb9c74e7a45279ae6f5581a497a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:25.205230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b1a16db1-f0cd-416a-980c-0970ac3e44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:25.312290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 699/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Wed Aug 17 08:31:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:25.321447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:25.322966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:25.425184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:25.466723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0dba-ca99-4941-9220-c7c5575e6481 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:25.571190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:25.571808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:25.572078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:25.572339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:25.573930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:25.661868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:25.663445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431f916-e277-48cb-832d-43f8082ebfd1 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:25.667393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:25.676083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 701/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:31:26.206563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:26.207096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:26.207096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:26.208590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 700/1401] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:26.214583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a171e3-3c58-4242-8f40-10022831c71e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:26.215337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a171e3-3c58-4242-8f40-10022831c71e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:26.215650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a171e3-3c58-4242-8f40-10022831c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:26.285645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-56a171e3-3c58-4242-8f40-10022831c71e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:26.286872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-56a171e3-3c58-4242-8f40-10022831c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:26.388900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 702/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:26.680577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:26.682141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:26.742501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:26.837550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fcfea-710b-41a4-b319-5e9b12623899 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:26.970069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:26.970697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:26.970973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:26.971241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:26.973092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:26.991253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:27.073478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:27.075113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddb1e1-2bf4-429c-83cf-23ef886df948 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:27.095358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 701/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:29.119710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:29.120119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:29.120322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:29.122011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 703/1404] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:29.127096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e027-5948-43cd-b72d-84176ec4d433 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:29.127517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e027-5948-43cd-b72d-84176ec4d433 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:29.127930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e027-5948-43cd-b72d-84176ec4d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:29.204662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2f36e027-5948-43cd-b72d-84176ec4d433 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:29.205882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2f36e027-5948-43cd-b72d-84176ec4d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:29.306180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:29.314924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 702/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:29.606559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:29.608115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:29.712392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:29.788911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2172211-ecd1-4862-a02b-00f843ec4868 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:29.920178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:29.920795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:29.921107 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:29.921345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:29.922971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:29.966452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:30.020739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:30.022442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb10d8-94dc-4699-92da-e160d0c67184 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:30.043206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 704/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:31.989914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:31.990512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:31.990512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:31.991817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 703/1407] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:31.997844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba097d-dba5-4835-b025-89e960481df4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:31.998332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba097d-dba5-4835-b025-89e960481df4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:31.998447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba097d-dba5-4835-b025-89e960481df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:32.066266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-60ba097d-dba5-4835-b025-89e960481df4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:32.067733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-60ba097d-dba5-4835-b025-89e960481df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:32.173101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 705/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:32.469097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:32.470628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:32.639255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89bb8-06e2-44a7-aef7-a572e76a7ff0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:32.712221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:32.762712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:32.763315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:32.763615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:32.763885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:32.765472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:32.869845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:32.871685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e2e8-8124-4815-93ae-393e0e78189b service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:32.891855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 704/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:42.171030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:42.887614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=65 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:47.556515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99382e9-1169-4bd1-9c07-dc8689e8d142 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:47.557113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99382e9-1169-4bd1-9c07-dc8689e8d142 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:47.557113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99382e9-1169-4bd1-9c07-dc8689e8d142 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:47.558438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 706/1410] 10.222.0.15 () {54 vars in 918 bytes} [Wed Aug 17 08:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:47.563486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7add-b509-4b6c-b45e-16c3559fefc2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:47.563994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7add-b509-4b6c-b45e-16c3559fefc2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:47.564090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7add-b509-4b6c-b45e-16c3559fefc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:47.638972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7c4a7add-b509-4b6c-b45e-16c3559fefc2 None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:47.640202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7c4a7add-b509-4b6c-b45e-16c3559fefc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:47.744993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 705/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 17 08:31:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:47.758891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb2e2-0c04-4d45-85ea-35cafd72e593 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:47.759174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb2e2-0c04-4d45-85ea-35cafd72e593 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:47.759449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb2e2-0c04-4d45-85ea-35cafd72e593 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:47.760800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 707/1412] 10.222.0.15 () {54 vars in 918 bytes} [Wed Aug 17 08:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:31:47.765378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27091-fcc7-4029-8c5f-a5ea4fff49ed None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:47.765659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27091-fcc7-4029-8c5f-a5ea4fff49ed None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:47.765929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f27091-fcc7-4029-8c5f-a5ea4fff49ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:47.838520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:47.841311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d7f27091-fcc7-4029-8c5f-a5ea4fff49ed None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:47.843036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d7f27091-fcc7-4029-8c5f-a5ea4fff49ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:47.957314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 706/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 17 08:31:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:50.307000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:50.307493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:50.307648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:50.308897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:50.314153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed794fa-3e4b-4ce5-ab3b-6349c93a8b56 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:50.314572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed794fa-3e4b-4ce5-ab3b-6349c93a8b56 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:50.314697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed794fa-3e4b-4ce5-ab3b-6349c93a8b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:50.380041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2ed794fa-3e4b-4ce5-ab3b-6349c93a8b56 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:50.381240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2ed794fa-3e4b-4ce5-ab3b-6349c93a8b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:50.435662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:50.478232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:50.767331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:50.768887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:50.911336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bc257-b660-44f3-b95d-7644b5964f4e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:50.981789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:51.021995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:51.022594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:51.022869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:51.023137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:51.024761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:51.116531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:51.118223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe89e-a954-4d3b-bcde-6a52a751aea2 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:51.136663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 709/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:52.016365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:52.016923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:52.016923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:52.018268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:52.023070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264d55-5ecb-48da-bff8-38d41791a0b0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:52.023500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264d55-5ecb-48da-bff8-38d41791a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:52.023640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264d55-5ecb-48da-bff8-38d41791a0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:52.098450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-65264d55-5ecb-48da-bff8-38d41791a0b0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:52.099698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-65264d55-5ecb-48da-bff8-38d41791a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:52.127236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:52.197397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:52.347784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:52.349235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:52.494743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea106a8-c9ff-4b9b-be72-07c1c6c99920 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:52.534899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:52.607566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:52.608100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:52.608375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:52.608644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:52.610276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:52.699047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:52.700937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e7cfe-4e22-4678-8ced-493b8d07cef3 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:52.718819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 709/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:53.595022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:53.595535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:53.595535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:53.596869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:53.601737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0421-725b-494b-981f-a681e3a4a534 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:53.602130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0421-725b-494b-981f-a681e3a4a534 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:53.602274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0421-725b-494b-981f-a681e3a4a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:53.656494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:53.678157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2e4a0421-725b-494b-981f-a681e3a4a534 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:53.679911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2e4a0421-725b-494b-981f-a681e3a4a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:53.775607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:53.926946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:53.928647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:54.076270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7163d0-d64e-41ba-92ef-cb9d8efeadbf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:54.088921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:54.187319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:54.187955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:54.188232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:54.188503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:54.190089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:54.279414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:54.281047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de96a0-6ff3-4dd7-a8ec-24f937d3eb35 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:54.298640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 712/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:55.150490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:55.150960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:55.151067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:55.152425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:55.157211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972034-66c2-4dd1-8a4d-490c3c66cc61 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:55.157642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972034-66c2-4dd1-8a4d-490c3c66cc61 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:55.157740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972034-66c2-4dd1-8a4d-490c3c66cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:55.177395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:55.233148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-78972034-66c2-4dd1-8a4d-490c3c66cc61 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:55.234352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-78972034-66c2-4dd1-8a4d-490c3c66cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:55.330400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:55.481890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:55.483359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:55.591437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:55.628293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55157c-c8ea-4190-bcb1-20be681606a5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:55.739624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:55.740170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:55.740445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:55.740713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:55.742897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:55.817169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:55.831506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:55.833124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95298b-ba08-4343-9f05-30e57fe2a1ad service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:55.850829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 712/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:56.712649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:56.713218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:56.713218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:56.714523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:56.719535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3012-521d-4b53-abce-db17fa9e4126 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:56.719999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3012-521d-4b53-abce-db17fa9e4126 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:56.720104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3012-521d-4b53-abce-db17fa9e4126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:56.793918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-735f3012-521d-4b53-abce-db17fa9e4126 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:56.795105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-735f3012-521d-4b53-abce-db17fa9e4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:56.889706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:57.039939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:57.041446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:57.125297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:57.188335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b57869-2aa3-41b8-bd20-85d5633f8db3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:57.303908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:57.304510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:57.304785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:57.305055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:57.306637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:57.354113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:57.395651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:57.397249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2e7e6-0959-4854-8062-68f9f0df1505 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:57.415341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 715/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:58.215814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:58.216383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:58.216383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:58.217747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:58.222608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e18-1230-4081-a24f-86047a4fdd62 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:58.223030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e18-1230-4081-a24f-86047a4fdd62 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:58.223145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e18-1230-4081-a24f-86047a4fdd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:58.296388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-feea3e18-1230-4081-a24f-86047a4fdd62 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:58.297598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-feea3e18-1230-4081-a24f-86047a4fdd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:58.392245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:31:58.542055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:31:58.543531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:58.592150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:58.690643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ffc2f-0716-449d-9859-25377f9784e6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:31:58.802704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:31:58.803223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:58.803495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:58.803794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:58.805961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:58.812771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:58.893783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:31:58.895360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f2c7b-24d5-44ae-9aff-20f27ba30c2b service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:31:58.913399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 715/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:59.712980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:59.713541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:59.713744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:59.714911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:31:59.719835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076494-b345-4c48-97c0-f316b69f9d54 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:31:59.720278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076494-b345-4c48-97c0-f316b69f9d54 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:31:59.720383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076494-b345-4c48-97c0-f316b69f9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:31:59.795211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-41076494-b345-4c48-97c0-f316b69f9d54 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:31:59.796450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-41076494-b345-4c48-97c0-f316b69f9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:31:59.863870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:59.893873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:00.043892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:00.045384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:00.062990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:00.187616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d4a29-78b5-4b9b-aae8-a242262bd550 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:00.276056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:00.302034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:00.302639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:00.302914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:00.303184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:00.304804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:00.392742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:00.394332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8235c7-c0e7-4af5-bb8d-9bbd388c06f6 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:00.412528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 718/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:01.215696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:01.216233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:01.216233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:01.217568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:01.222401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db192b6-c731-40c6-a02b-929924917a9f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:01.222813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db192b6-c731-40c6-a02b-929924917a9f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:01.222945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db192b6-c731-40c6-a02b-929924917a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:01.304381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3db192b6-c731-40c6-a02b-929924917a9f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:01.306226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3db192b6-c731-40c6-a02b-929924917a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:01.346972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:01.401392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:01.551107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:01.552648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:01.697468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0feb32-c5a9-4686-b638-daf932ec899f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:01.751727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:01.810355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:01.810954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:01.811230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:01.811493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:01.813128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:01.901135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:01.902705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b541b-71e7-474c-b556-bea6d21d2963 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:01.920799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 718/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:02.717305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:02.717869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:02.717869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:02.719190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:02.723978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5145f-06e2-453f-b638-b00909fdb8de None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:02.724420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5145f-06e2-453f-b638-b00909fdb8de None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:02.724542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5145f-06e2-453f-b638-b00909fdb8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:02.799091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-dde5145f-06e2-453f-b638-b00909fdb8de None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:02.800375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dde5145f-06e2-453f-b638-b00909fdb8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:02.802325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:02.896969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:03.045565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:03.047081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:03.191531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b053-f156-4c98-a851-7b8519aba5c1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:03.217867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:03.301205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:03.301813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:03.302074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:03.302342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:03.303940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:03.392143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:03.393679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b85e0e-25b1-49c4-8f92-2c7520f52f42 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:03.411515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 721/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:05.199294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0e31-13f9-462f-8760-138996119e3b None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:05.199827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0e31-13f9-462f-8760-138996119e3b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:05.199827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0e31-13f9-462f-8760-138996119e3b None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:05.201485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:32:05.206956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b5fbf-2e9f-4abe-a86c-682f57d1560e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:05.207376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b5fbf-2e9f-4abe-a86c-682f57d1560e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:05.207494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b5fbf-2e9f-4abe-a86c-682f57d1560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:05.247157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:05.272728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-256b5fbf-2e9f-4abe-a86c-682f57d1560e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:05.273964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-256b5fbf-2e9f-4abe-a86c-682f57d1560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:05.378623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:05.663599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0e31-13f9-462f-8760-138996119e3b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:05.665139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-445d0e31-13f9-462f-8760-138996119e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:05.768143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0e31-13f9-462f-8760-138996119e3b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:05.799279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:05.842141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:05.842737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:05.843015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:05.843284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:05.844896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:05.950668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:05.952375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7beae-3947-4c6c-8cf0-96176484c9b4 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:05.970335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 721/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:08.032795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:08.033333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:08.033333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:08.034673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:08.040603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37623-6e09-4be0-aaa3-510c7900d4fe None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:08.040995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37623-6e09-4be0-aaa3-510c7900d4fe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:08.041151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37623-6e09-4be0-aaa3-510c7900d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:08.109971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f9d37623-6e09-4be0-aaa3-510c7900d4fe None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:08.111193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f9d37623-6e09-4be0-aaa3-510c7900d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:08.124202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:08.220890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:08.507003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:08.509130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:08.617480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cbab1-c9bd-419d-8946-09c277f4d101 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:08.630276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:08.694255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:08.694773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:08.695048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:08.695316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:08.697553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:08.803175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:08.804627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b17e3-9e81-41f6-a888-082121ba863c service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:08.823222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 724/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:11.006903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:11.007439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:11.007439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:11.009469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:11.014579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56eb9-4fe0-4ac0-9afe-23bc391e0449 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:11.014986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56eb9-4fe0-4ac0-9afe-23bc391e0449 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:11.015099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56eb9-4fe0-4ac0-9afe-23bc391e0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:11.067400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:11.086058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f7b56eb9-4fe0-4ac0-9afe-23bc391e0449 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:11.087293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f7b56eb9-4fe0-4ac0-9afe-23bc391e0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:11.182629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:11.471588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:11.473139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:11.576911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad0709-8dc6-4497-8114-c9e5efeb1c62 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:11.617369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:11.652073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:11.652681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:11.652956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:11.653226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:11.654812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:11.762368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:11.763755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da670ef1-7cdb-4cca-ab3e-dd9b2be9d9ac service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:11.781894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 724/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:13.775119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:13.775690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:13.775690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:13.777027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:13.782302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038b437-d9f3-463c-81f3-3fa01f68bf0d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:13.782698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038b437-d9f3-463c-81f3-3fa01f68bf0d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:13.782842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038b437-d9f3-463c-81f3-3fa01f68bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:13.847637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2038b437-d9f3-463c-81f3-3fa01f68bf0d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:13.848837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2038b437-d9f3-463c-81f3-3fa01f68bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:13.869625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:13.943772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:14.231708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:14.233240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:14.333331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8740f-e12d-4220-80c5-02ae910acb3a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:14.352951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:14.407098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:14.407744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:14.408022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:14.408289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:14.409872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:14.515677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:14.517024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818fe5b-586f-42b4-a7f1-bd5982706011 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:14.535126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 727/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:16.482397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:16.482964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:16.482964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:16.484321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:16.489323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac48-7dc2-4600-bca5-ea1a9000b23c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:16.489806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac48-7dc2-4600-bca5-ea1a9000b23c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:16.489903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac48-7dc2-4600-bca5-ea1a9000b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:16.552190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:16.555029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b862ac48-7dc2-4600-bca5-ea1a9000b23c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:16.556802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b862ac48-7dc2-4600-bca5-ea1a9000b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:16.653232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:16.933526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:16.935119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:17.036663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db97fb-1a9b-429d-bd06-e65aaf5f7ee3 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:17.085183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:17.110909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:17.111507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:17.111818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:17.112086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:17.113695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:17.221644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:17.223015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9393f4-6404-4b8d-a059-70f9b6569458 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:17.242846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 727/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:19.172128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:19.172549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:19.172661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:19.174004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:19.179183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193b39e-ea0f-4db6-83c8-e9dece8c191b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:19.179588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193b39e-ea0f-4db6-83c8-e9dece8c191b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:19.179756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193b39e-ea0f-4db6-83c8-e9dece8c191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:19.245290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b193b39e-ea0f-4db6-83c8-e9dece8c191b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:19.246477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b193b39e-ea0f-4db6-83c8-e9dece8c191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:19.274786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:19.341516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:32:19.624596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:19.626148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:19.728161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ed2a-7638-48cc-b0b6-18250ae172a2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:19.756455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:19.800783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:19.801382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:19.801659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:19.801929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:19.803517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:19.909557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:19.910969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47b21f-36b4-43ea-9551-bd4816e7c8c9 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:19.928857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 730/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:21.955705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:21.956267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:21.956267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:21.957576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:21.962898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7b7e-a1bc-4107-bdaa-c3c1693952cb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:21.963281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7b7e-a1bc-4107-bdaa-c3c1693952cb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:21.963453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7b7e-a1bc-4107-bdaa-c3c1693952cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:22.027568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4bcf7b7e-a1bc-4107-bdaa-c3c1693952cb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:22.028761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4bcf7b7e-a1bc-4107-bdaa-c3c1693952cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:22.036987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:22.124450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:22.404857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:22.406399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:22.508419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70dc61-57a4-41bf-8cfc-965a8ac68617 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:22.563319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:22.581830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:22.582422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:22.582694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:22.582959 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:22.584576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:22.691634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:22.693033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab3f1f-a30e-406a-956b-d3ff28b3c1bb service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:22.711170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 730/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:24.653506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:24.654019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:24.654130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:24.655451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:24.660707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856acc-4005-4c2d-8942-20ed24d63910 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:24.661131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856acc-4005-4c2d-8942-20ed24d63910 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:24.661227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856acc-4005-4c2d-8942-20ed24d63910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:24.726790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-88856acc-4005-4c2d-8942-20ed24d63910 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:24.728013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-88856acc-4005-4c2d-8942-20ed24d63910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:24.766255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:24.827927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:25.110583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:25.112161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:25.216005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe567f-7c82-4d42-9469-7fb9933a832e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:25.252754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:25.287633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:25.288229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:25.288503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:25.288769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:25.290948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:25.399891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:25.401345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961ec8b-84eb-4332-bc95-b769ffc5b5d6 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:25.419406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 733/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:27.291464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec855-af21-4703-a919-8053acb7a019 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:27.292014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec855-af21-4703-a919-8053acb7a019 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:27.292142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec855-af21-4703-a919-8053acb7a019 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:27.293428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:27.298657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf2faa-525c-4908-b927-9c675e4e447a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:27.299069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf2faa-525c-4908-b927-9c675e4e447a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:27.299200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf2faa-525c-4908-b927-9c675e4e447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:27.364945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7cdf2faa-525c-4908-b927-9c675e4e447a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:27.366172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7cdf2faa-525c-4908-b927-9c675e4e447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:27.384081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:27.462407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:27.746329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec855-af21-4703-a919-8053acb7a019 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:27.747981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-39aec855-af21-4703-a919-8053acb7a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:27.850918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec855-af21-4703-a919-8053acb7a019 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:27.916308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:27.923439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:27.924064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:27.924338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:27.924603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:27.926175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:28.032113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:28.033457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc4ee7-2771-4e64-8bab-4962f659ad97 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:28.051828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 733/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:29.953775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:29.954336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:29.954336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:29.955688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:29.960961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90ef1-ac10-428a-92c0-e7b6e731c432 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:29.961389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90ef1-ac10-428a-92c0-e7b6e731c432 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:29.961492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90ef1-ac10-428a-92c0-e7b6e731c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:30.028495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b6e90ef1-ac10-428a-92c0-e7b6e731c432 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:30.029687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b6e90ef1-ac10-428a-92c0-e7b6e731c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:30.077104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:30.124784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:30.408972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:30.410536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:30.512351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd848f3-412f-4f9a-b12e-44faf793d710 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:30.558277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:30.584286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:30.584882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:30.585159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:30.585426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:30.587502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:30.694151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:30.695592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bcf35-f420-41d2-9461-6c39796502da service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:30.714050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 736/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:40.122955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=22 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:40.711273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=66 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:49.964312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfc46-839f-4969-9781-1c3c5a5cb7c5 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:49.964846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfc46-839f-4969-9781-1c3c5a5cb7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:49.964846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfc46-839f-4969-9781-1c3c5a5cb7c5 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:49.966200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 735/1471] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:49.971480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc68f-69d5-44af-a396-cf46447fcf6a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:49.971939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc68f-69d5-44af-a396-cf46447fcf6a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:49.972051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cc68f-69d5-44af-a396-cf46447fcf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:50.037048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4c7cc68f-69d5-44af-a396-cf46447fcf6a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:50.038275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4c7cc68f-69d5-44af-a396-cf46447fcf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:50.133838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 737/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:50.431791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:50.432075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:50.432348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:50.433708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 736/1473] 10.222.0.15 () {54 vars in 967 bytes} [Wed Aug 17 08:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:50.438589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769874a-19b1-43d6-880b-adf35f39322d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:50.438869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769874a-19b1-43d6-880b-adf35f39322d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:50.439138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769874a-19b1-43d6-880b-adf35f39322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:50.512803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8769874a-19b1-43d6-880b-adf35f39322d None None] MFA Rules not processed for user `c633e39c46f94f608a0887fe25312310`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:50.513992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8769874a-19b1-43d6-880b-adf35f39322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:50.534128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:50.590594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 738/1474] 10.222.0.15 () {58 vars in 1064 bytes} [Wed Aug 17 08:32:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:50.598105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:50.599629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:50.702584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354751-610f-4554-8a1d-4a00d48eed46 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:50.774596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:50.775193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:50.775472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:50.775772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:50.777373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:50.830722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:50.886062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:50.887487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238ca52-0cc7-4c1c-9937-5a0c69f9c1f7 service glance] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:50.905664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 737/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:52.886374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:52.886921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:52.886921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:52.888283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 739/1476] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:52.893403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf744d-6721-4da3-9823-9155b104d461 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:52.893822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf744d-6721-4da3-9823-9155b104d461 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:52.893944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf744d-6721-4da3-9823-9155b104d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:52.959940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-3abf744d-6721-4da3-9823-9155b104d461 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:52.961152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3abf744d-6721-4da3-9823-9155b104d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:53.057195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 738/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:53.326103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:53.327643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:53.567506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b0be-39d2-4f4c-8f2b-7cb614671056 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:53.617681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:53.661761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:53.662367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:53.662614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:53.662879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:53.663521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:53.665282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:32:53.665282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:32:53.665282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:32:53.666411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e64b-a2eb-40f9-a9c9-cc888fb3e8ce admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:53.685300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 740/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 17 08:32:53 2022] GET /identity/v3/projects => generated 2553 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:32:55.596456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:55.597080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:55.597080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:55.598260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 739/1479] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:55.603893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f6d1-4bd6-4097-9a8a-55ef1c67e625 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:55.604366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f6d1-4bd6-4097-9a8a-55ef1c67e625 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:55.604471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f6d1-4bd6-4097-9a8a-55ef1c67e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:55.669234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3ed2f6d1-4bd6-4097-9a8a-55ef1c67e625 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:55.670444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3ed2f6d1-4bd6-4097-9a8a-55ef1c67e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:55.764395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 741/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:56.052388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:56.054068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:56.063622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:56.198030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c3eb-617a-45f3-85ab-c86ff22259f4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:56.277083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:56.309075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:56.309611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:56.309886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:56.310151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:56.311751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:56.400115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:56.401703 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbc4a1-c968-41fc-ae72-c89b0ae51376 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:56.419645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 740/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:32:58.503921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:58.504479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:58.504479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:58.505799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 742/1482] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:32:58.511728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebe5f-cb6a-4425-920b-29b8548f2ea1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:58.512158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebe5f-cb6a-4425-920b-29b8548f2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:58.512304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebe5f-cb6a-4425-920b-29b8548f2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:58.577767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5d3ebe5f-cb6a-4425-920b-29b8548f2ea1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:32:58.579227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5d3ebe5f-cb6a-4425-920b-29b8548f2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:58.625627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:58.677975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 741/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:32:58.967625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:32:58.969170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:58.992865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:59.072885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114530d-e97a-4848-9a29-9a4863167108 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:32:59.145307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:32:59.145912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:32:59.146221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:32:59.146533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:32:59.148253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:32:59.222258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:59.256421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:32:59.257842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8561a4-957c-4b24-b3ae-6fea7dd31f7f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:32:59.276781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 743/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:33:01.216001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:01.216466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:01.216563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:01.217931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 742/1485] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:33:01.223069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747bd11-b8df-4565-81e0-7274f08f25c3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:01.223467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747bd11-b8df-4565-81e0-7274f08f25c3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:01.223637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747bd11-b8df-4565-81e0-7274f08f25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:01.287725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-7747bd11-b8df-4565-81e0-7274f08f25c3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:33:01.288927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7747bd11-b8df-4565-81e0-7274f08f25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:01.383290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 744/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:33:01.669325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:33:01.670921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:01.773116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409fc90-c782-4023-a7ea-51d88ee0f63e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:33:01.844633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:01.846492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:33:01.847252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:01.847829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:01.848274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:01.850044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:01.958565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:33:01.960022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d603d17-0d23-4c70-b95f-afeea31f27a6 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:33:01.979316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 743/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:33:03.987578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:03.988142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:03.988142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:03.989464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 745/1488] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:33:03.995425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e289-17fc-4738-9834-067db410e628 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:03.995858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e289-17fc-4738-9834-067db410e628 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:03.996001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e289-17fc-4738-9834-067db410e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:04.061485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8903e289-17fc-4738-9834-067db410e628 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:33:04.062720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8903e289-17fc-4738-9834-067db410e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:04.114944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:04.159080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 744/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:33:04.456003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:33:04.457574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:04.493265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:04.559992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70318-69ae-4472-8430-579ee3a173b6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:33:04.632595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:33:04.633199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:04.633472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:04.634314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:04.635944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:04.715530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:04.744544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:33:04.745969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143eef3-04f7-45eb-9db7-5a68c19faaf0 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:33:04.764087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 746/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:33:06.818121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:06.818670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:06.818670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:06.820056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 745/1491] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 17 08:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:33:06.825125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa866c-2785-469f-a53e-6d8db8fcb21a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:06.825542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa866c-2785-469f-a53e-6d8db8fcb21a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:06.825681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa866c-2785-469f-a53e-6d8db8fcb21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:06.890445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-65aa866c-2785-469f-a53e-6d8db8fcb21a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:33:06.891682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-65aa866c-2785-469f-a53e-6d8db8fcb21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:06.986647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 747/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 17 08:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:33:07.277844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:33:07.279398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:07.383193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca847f-7cc2-45d9-80c5-eda27db8fe64 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:33:07.455340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:33:07.455907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:33:07.456186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:33:07.456456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:33:07.458056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:33:07.467637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:07.566873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:33:07.568323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b1bd-a90b-4bc5-9c37-8d7d1dc69675 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:33:07.587514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 746/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:33:16.984827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=82 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:33:17.584748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=50 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:18.238953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:18.239564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:18.239564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:18.312523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:34:18.313720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:18.407372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 748/1494] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:34:18.416242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:18.416727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:18.416826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:18.491776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:34:18.492920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:18.587382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 747/1495] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:34:18.592111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:18.593315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:18.605199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c0bb-8655-4001-9b08-073c3050f69a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:18.667468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:18.706262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:18.706880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:18.707154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:18.707418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:18.708100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:34:18.708397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:18.709419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:18.709419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:34:18.709419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:34:18.710326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:18.723654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 749/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:34:18.732675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:18.742533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d2422-e343-4417-806e-57ea374b6af2 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:18.805473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:18.841054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:18.841652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:18.841926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:18.842191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:18.842797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:18.844525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:18.844525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:34:18.844525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:34:18.845710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:18.900120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 748/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:34:18 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:34:18.904263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:18.905792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:18.937941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be530-1e08-4698-8601-7e56b25ef7a0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:19.029571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:19.030090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.030362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.030628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.031230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:19.032259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:19.032259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:34:19.032259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:34:19.033456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:19.074266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 750/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:34:18 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:34:19.078326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:19.079847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.141284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d283b-54ad-480f-a4af-649644e81243 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:19.225789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:19.237253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:19.237862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.238137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.238407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.239043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:19.240080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:19.240080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:34:19.240080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:34:19.241015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:19.253245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 749/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:34:19.257292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:19.258868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.270251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861d22f-e3b3-4843-a6ec-27dafddf6fec admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:19.296323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:19.366275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:19.366878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.367157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.367429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.368105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:19.369127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:19.369127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:34:19.369127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:34:19.370050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200727-afd4-4c60-9436-bb8c37cfc8a2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:19.382540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 751/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:34:19.386909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:19.388449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.422175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd580a-1bfb-4ef0-8765-950fdeeb19fe admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:19.515692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:19.516353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.516632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.516901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] PATH_INFO: `/v3/projects/10cb343eff5a4ceda91e8b9f9e0a3662/users/ac44160331d94932812598f50c92509f/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.539281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cb343eff5a4ceda91e8b9f9e0a3662, user_id=ac44160331d94932812598f50c92509f, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:19.540371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:19.540371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:34:19.540371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:34:19.542315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024cee-40fa-4d01-b2e2-8d14e4513367 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:19.566287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 750/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:34:19 2022] PUT /identity/v3/projects/10cb343eff5a4ceda91e8b9f9e0a3662/users/ac44160331d94932812598f50c92509f/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:34:19.578816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30843-5721-4375-9f9a-6c434247a38d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.579101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30843-5721-4375-9f9a-6c434247a38d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.579378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30843-5721-4375-9f9a-6c434247a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.636141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f6c30843-5721-4375-9f9a-6c434247a38d None None] MFA Rules not processed for user `ac44160331d94932812598f50c92509f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:34:19.637348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f6c30843-5721-4375-9f9a-6c434247a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.719408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 752/1502] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:34:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:34:19.729531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.729819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.730094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.731430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 751/1503] 10.222.0.15 () {54 vars in 964 bytes} [Wed Aug 17 08:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:34:19.736482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a28e5-3310-4432-95b3-70a2c259a63d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:19.736768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a28e5-3310-4432-95b3-70a2c259a63d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:19.737043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a28e5-3310-4432-95b3-70a2c259a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:19.769355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:19.813699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f19a28e5-3310-4432-95b3-70a2c259a63d None None] MFA Rules not processed for user `4d70f0f7e72a4d658218f9c8fcf64737`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:34:19.814912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f19a28e5-3310-4432-95b3-70a2c259a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.889142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 753/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Aug 17 08:34:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:34:19.897405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:19.899465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:19.948754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:20.004938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e62a-4a46-4472-a17f-538984965e6a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:20.078083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:20.079102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:20.079653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:20.080163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:20.083564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:20.188059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:20.189408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:20.192857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:20.207606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 752/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:34:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:34:20.253239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3294-3a0b-44a0-a8d2-ffd68c1b05bb None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:20.253523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3294-3a0b-44a0-a8d2-ffd68c1b05bb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:20.253794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3294-3a0b-44a0-a8d2-ffd68c1b05bb None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:20.255053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 754/1506] 10.222.0.15 () {52 vars in 830 bytes} [Wed Aug 17 08:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:34:20.259232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:20.260463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:20.358146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6bfa-ce5e-4111-8093-46aa16af833c service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:20.450281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:20.450926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:20.451106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:20.451376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] PATH_INFO: `/v3/users/ac44160331d94932812598f50c92509f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:20.464287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac44160331d94932812598f50c92509f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:20.465300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:20.465300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:34:20.465300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:34:20.466511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:20.476397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:20.531624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac44160331d94932812598f50c92509f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:20.553918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac44160331d94932812598f50c92509f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:20.562866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac44160331d94932812598f50c92509f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:20.563366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac44160331d94932812598f50c92509f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:20.579416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac44160331d94932812598f50c92509f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:20.585164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 753/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:34:20 2022] DELETE /identity/v3/users/ac44160331d94932812598f50c92509f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:34:20.590188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:20.590704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:20.590818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:20.646294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:34:20.647484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:20.721036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:20.733579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 755/1508] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:34:20.744244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:20.745446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:20.843157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ad17-26dd-463e-8622-7a71110b7372 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:20.897065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:20.916839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:20.917438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:20.917711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:20.917976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:20.919534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:21.025764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:21.027109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aab6d-e554-4a65-940e-171ee81e1d5f service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:21.045827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 754/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:34:21.401418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:34:21.402676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:34:21.415201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754a40-8a2c-431b-b37e-e6c6e4e67cdd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:34:21.511097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:34:21.511747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:34:21.512019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:34:21.512283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] PATH_INFO: `/v3/projects/10cb343eff5a4ceda91e8b9f9e0a3662` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:34:21.521775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cb343eff5a4ceda91e8b9f9e0a3662)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:34:21.522774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:34:21.522774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:34:21.522774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:34:21.524527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:34:21.580036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cb343eff5a4ceda91e8b9f9e0a3662', 'request_id': 'req-93fcb541-0243-41b5-a704-3b2e7e66c65e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:21.586168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cb343eff5a4ceda91e8b9f9e0a3662', 'request_id': 'req-93fcb541-0243-41b5-a704-3b2e7e66c65e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:21.597244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cb343eff5a4ceda91e8b9f9e0a3662', 'request_id': 'req-93fcb541-0243-41b5-a704-3b2e7e66c65e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:21.627017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] The token cache is being invalidate because project 10cb343eff5a4ceda91e8b9f9e0a3662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:34:21.627353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:21.627910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93fcb541-0243-41b5-a704-3b2e7e66c65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:34:21.629189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 756/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:34:21 2022] DELETE /identity/v3/projects/10cb343eff5a4ceda91e8b9f9e0a3662 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:34:31.043640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=62 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:34:31.625015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:35:47.162835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:47.163462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:47.163462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:47.165393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:35:47.170132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b945f-04a7-47ba-bc7c-a56886be018c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:47.170606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b945f-04a7-47ba-bc7c-a56886be018c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:47.170713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b945f-04a7-47ba-bc7c-a56886be018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:47.251379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5f7b945f-04a7-47ba-bc7c-a56886be018c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:35:47.252617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5f7b945f-04a7-47ba-bc7c-a56886be018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:47.353494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:35:47.505072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:35:47.507228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:47.626198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9f0a-fae7-493a-8fdf-e4bf49ada422 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:35:47.631687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:35:47.632293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:47.632572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:47.632846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:47.640970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:35:47.642541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f8921-7931-495e-b2d5-3d4aa0cfec5f service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:35:47.652707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 756/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:35:48.477194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dc57e-5783-4140-a36c-cdf793c06b63 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:48.477738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dc57e-5783-4140-a36c-cdf793c06b63 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:48.477738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dc57e-5783-4140-a36c-cdf793c06b63 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:48.479127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:35:48.484033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307f66-e2c3-47f5-853b-31f3c63fb0f3 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:48.484459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307f66-e2c3-47f5-853b-31f3c63fb0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:48.484564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2307f66-e2c3-47f5-853b-31f3c63fb0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:48.504051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f2307f66-e2c3-47f5-853b-31f3c63fb0f3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:35:48.505236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f2307f66-e2c3-47f5-853b-31f3c63fb0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:48.513558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:35:48.668138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dc57e-5783-4140-a36c-cdf793c06b63 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:35:48.682956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dc57e-5783-4140-a36c-cdf793c06b63 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:35:48.688468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:35:48.689060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:48.689341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:48.689613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:48.698679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:35:48.700390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5a50-909e-4038-99b7-8bd4e8f6949e service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:35:48.710347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 759/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:35:49.271455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2117-0ae8-478b-8ec3-3c13b3aee266 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:49.272267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2117-0ae8-478b-8ec3-3c13b3aee266 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:49.272267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc2117-0ae8-478b-8ec3-3c13b3aee266 None None] PATH_INFO: `/v3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:49.273472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 758/1517] 10.222.0.23 () {54 vars in 925 bytes} [Wed Aug 17 08:35:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:35:49.280929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8254-8636-4402-97af-0e2ea3a3fd4d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:49.281211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8254-8636-4402-97af-0e2ea3a3fd4d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:49.281485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8254-8636-4402-97af-0e2ea3a3fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:49.339426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-019b8254-8636-4402-97af-0e2ea3a3fd4d None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:35:49.340662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-019b8254-8636-4402-97af-0e2ea3a3fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:49.357584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:35:49.410813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 760/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Aug 17 08:35:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:35:58.171017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925e36-2313-4cad-aaf7-fd678ebfe2ed None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:58.171570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925e36-2313-4cad-aaf7-fd678ebfe2ed None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:58.171570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925e36-2313-4cad-aaf7-fd678ebfe2ed None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:58.172860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 759/1519] 10.222.0.15 () {54 vars in 961 bytes} [Wed Aug 17 08:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:35:58.178150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab9aa8-cff6-47b5-8eb3-d8a39e10cc77 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:58.178550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab9aa8-cff6-47b5-8eb3-d8a39e10cc77 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:58.178703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab9aa8-cff6-47b5-8eb3-d8a39e10cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:58.198968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-33ab9aa8-cff6-47b5-8eb3-d8a39e10cc77 None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:35:58.200194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-33ab9aa8-cff6-47b5-8eb3-d8a39e10cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:58.208949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 761/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Aug 17 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:35:58.216205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925e36-2313-4cad-aaf7-fd678ebfe2ed None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:35:58.229282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925e36-2313-4cad-aaf7-fd678ebfe2ed None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:35:58.234155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:35:58.234735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:58.235015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:58.235290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:58.243917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:35:58.245478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70114-66d4-4b4f-b146-03fe8199dc40 service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:35:58.254884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 760/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:35:59.923238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66f4f-2ab4-4f10-9eea-ea2bea71b9db None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:59.923908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66f4f-2ab4-4f10-9eea-ea2bea71b9db None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:59.923908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66f4f-2ab4-4f10-9eea-ea2bea71b9db None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:59.925172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:35:59.930621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7689-aa20-47eb-9782-9c21c9527afe None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:35:59.931055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7689-aa20-47eb-9782-9c21c9527afe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:35:59.931178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7689-aa20-47eb-9782-9c21c9527afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:35:59.950690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d33b7689-aa20-47eb-9782-9c21c9527afe None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:35:59.951921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d33b7689-aa20-47eb-9782-9c21c9527afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:35:59.960174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:00.110349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66f4f-2ab4-4f10-9eea-ea2bea71b9db None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:00.125482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66f4f-2ab4-4f10-9eea-ea2bea71b9db None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:00.130864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:00.131457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:00.131768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:00.132042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:00.139955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:00.141548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ee8b-b947-46fd-97cb-fb5037eaeaa0 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:00.150739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 763/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:00.969692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c624a9-6fdd-4338-ad92-06266d6829f7 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:00.970225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c624a9-6fdd-4338-ad92-06266d6829f7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:00.970346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c624a9-6fdd-4338-ad92-06266d6829f7 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:00.971635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 08:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:36:00.976529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e7ca-8b9b-437c-8d33-29d6455f7cc6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:00.976952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e7ca-8b9b-437c-8d33-29d6455f7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:00.977053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e7ca-8b9b-437c-8d33-29d6455f7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:00.995729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f283e7ca-8b9b-437c-8d33-29d6455f7cc6 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:36:00.996913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f283e7ca-8b9b-437c-8d33-29d6455f7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:01.004620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 08:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:01.154423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c624a9-6fdd-4338-ad92-06266d6829f7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:01.168941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c624a9-6fdd-4338-ad92-06266d6829f7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:01.174447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:01.175032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:01.175312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:01.175600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:01.184019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:01.185597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa7c32-9fa1-4bf3-a9f5-4a161a73096c service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:01.194748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 763/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:04.923085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:04.923662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:04.923662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:04.924995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:36:04.930029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d98c-3412-4c87-b1e9-a90541ec4e74 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:04.930477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d98c-3412-4c87-b1e9-a90541ec4e74 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:04.930584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34d98c-3412-4c87-b1e9-a90541ec4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:04.950757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7a34d98c-3412-4c87-b1e9-a90541ec4e74 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:36:04.952002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7a34d98c-3412-4c87-b1e9-a90541ec4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:04.960196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:05.245459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:05.247192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:05.326613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a17b-572a-4eff-b8ce-f4587e5b7aa9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:05.330235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:05.330833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:05.331112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:05.331383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:05.341768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:05.343450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2e7d9-2cf7-4bcf-832d-724cbfe77e47 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:05.355200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 766/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:07.249490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79a55-fffb-4614-af4b-1687a0aca571 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:07.250053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79a55-fffb-4614-af4b-1687a0aca571 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:07.250053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79a55-fffb-4614-af4b-1687a0aca571 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:07.251347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:36:07.256508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d547c2-7328-4f1c-8ce5-5429893a348b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:07.256931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d547c2-7328-4f1c-8ce5-5429893a348b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:07.257042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d547c2-7328-4f1c-8ce5-5429893a348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:07.277547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-24d547c2-7328-4f1c-8ce5-5429893a348b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:36:07.278754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-24d547c2-7328-4f1c-8ce5-5429893a348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:07.286789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:07.571189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f79a55-fffb-4614-af4b-1687a0aca571 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:07.582142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f79a55-fffb-4614-af4b-1687a0aca571 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:07.586454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:07.587053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:07.587326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:07.587630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:07.596798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:07.598227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2400-d339-489c-a23b-e814b7741bc4 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:07.607917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 766/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:10.924176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:10.924716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:10.924716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:10.926055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:36:10.931824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c94e-c23c-4395-8775-7ab22039e5b9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:10.932273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c94e-c23c-4395-8775-7ab22039e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:10.932381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c94e-c23c-4395-8775-7ab22039e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:10.952069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6131c94e-c23c-4395-8775-7ab22039e5b9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:36:10.953270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6131c94e-c23c-4395-8775-7ab22039e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:10.961220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:11.507097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:11.508798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:11.572647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:11.586575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa360c3-4093-4604-810d-9aa1c998a8ee None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:11.590108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:11.590710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:11.590982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:11.591251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:11.600186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:11.602224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac693-67f8-4a21-acb7-fa7087bec48b service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:11.611599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 769/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:13.606034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:13.606536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:13.606536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:13.607858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 08:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:36:13.613191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b384-8719-474e-8e2e-da6a52972fe9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:13.613596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b384-8719-474e-8e2e-da6a52972fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:13.613733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b384-8719-474e-8e2e-da6a52972fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:13.633294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b070b384-8719-474e-8e2e-da6a52972fe9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:36:13.634508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b070b384-8719-474e-8e2e-da6a52972fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:13.642250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 08:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:36:14.182517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:36:14.184178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:36:14.191530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=84 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:14.197477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fae3d1-c735-449f-87fd-eb44a79cb94c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:36:14.200984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:36:14.201579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:36:14.201854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:36:14.202123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:36:14.211787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:36:14.213242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b314-4dd9-4d43-989b-f951bb77d9e9 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:36:14.222696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 769/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:36:23.628011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=11 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:24.218461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:35.240885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.244457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.244457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.266373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.267615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.280088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 771/1540] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.288993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.289540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.289540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.320883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.322089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.336272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 770/1541] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.340632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.355259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75daa-418b-4275-aa49-2b4f4ec70e86 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.365708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.367657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.367657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.367657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.367657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:35.368178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.369900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db14c1-65c2-4281-a206-35e8ac3a1719 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.400666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 772/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:35.408902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.425664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ac699-d7d7-427c-a1f4-900a1058a304 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.437436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.438272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.438783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.439213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.440075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.442251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.481133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860740-36ff-40e6-b52a-075c229772e1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.481133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860740-36ff-40e6-b52a-075c229772e1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.481133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860740-36ff-40e6-b52a-075c229772e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.520584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 771/1543] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:35.522580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bf860740-36ff-40e6-b52a-075c229772e1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.524185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf860740-36ff-40e6-b52a-075c229772e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.524446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.624529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 773/1544] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:37:35.626331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49461-e1d9-4e0a-834f-958e697be974 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.632508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49461-e1d9-4e0a-834f-958e697be974 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.633243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49461-e1d9-4e0a-834f-958e697be974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.669973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998587ed-edeb-426d-8b33-015b73fc3b55 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.679118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-48b49461-e1d9-4e0a-834f-958e697be974 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.681182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.683257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.683906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-48b49461-e1d9-4e0a-834f-958e697be974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.684386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.685963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.686824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.689181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:35.689181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:37:35.689181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:37:35.691253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db081-d818-4520-b83f-7c130ef3bf3f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.707351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 774/1545] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.709687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.711260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.711735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.751717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 772/1546] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:37:35.753435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.755062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.755560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.772512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.776196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.794318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 775/1547] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.795721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.808608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.810858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.821092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1becb8-990d-451e-a9f0-f66e6e397723 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.831625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 773/1548] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.834928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.836772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.838683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.840310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.840757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.841563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.849927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.854283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523f67-ff06-42fb-ba5a-3036b09529fc None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.865559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 776/1549] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:35.866753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.872693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.873441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.873813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.874201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.874961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:35.875363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.878684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:35.878684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:37:35.878684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:37:35.878684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1caa-2fbc-480b-95e9-94dfabbfbb2e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.884601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7a32a-cd99-4b28-a846-419c1adfe134 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.890645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 774/1550] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:35.892134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7e95-8dc1-4ff8-88e2-54bf574320e0 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.892521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7e95-8dc1-4ff8-88e2-54bf574320e0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.893051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc7e95-8dc1-4ff8-88e2-54bf574320e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.896882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.897969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.898990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.899267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.899956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:35.900260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.901918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.923566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 777/1551] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:35.923784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-12dc7e95-8dc1-4ff8-88e2-54bf574320e0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.923874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.924851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-12dc7e95-8dc1-4ff8-88e2-54bf574320e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.935708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98f50c-49de-4872-9524-faee0de88101 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:35.937121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 775/1552] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.938502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.939015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.939454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.949274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:35.951011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.951292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.951584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.952253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:35.954237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34af3a6-d0cb-4e0c-9b19-5826d6547d8e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:35.965581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:35.966992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:35.971770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 778/1553] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:35.973238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:35.973518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:35.974065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:35.976772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 776/1554] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:35.977753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:35.996194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c62e-33c1-4e88-8fcd-73902031503f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.001623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.002372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.002751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.003140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.003928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.006843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.007058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1543-65cd-4ef9-ab7d-fa31c36499eb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.008100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.016674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 779/1555] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.019574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.028952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553e659-1a94-49fe-9669-c60d8e505852 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.035849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.036851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.037132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.037412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.038043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.039053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:36.039053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:37:36.039053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:37:36.040282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.042302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 777/1556] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:35 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.043633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4590-64e5-4fd4-a303-4ac86b4909aa None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.043916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4590-64e5-4fd4-a303-4ac86b4909aa None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.044184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4590-64e5-4fd4-a303-4ac86b4909aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.062863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-46bf4590-64e5-4fd4-a303-4ac86b4909aa None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.064098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-46bf4590-64e5-4fd4-a303-4ac86b4909aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.068729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 780/1557] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.069574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.116400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.127299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 778/1558] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.128757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a469fd-5108-4b81-90fa-961942b010f7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.129046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a469fd-5108-4b81-90fa-961942b010f7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.129317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a469fd-5108-4b81-90fa-961942b010f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.135209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000c23-dad5-45f9-abbb-64cb21903957 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.139864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.140512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.140786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.141053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] PATH_INFO: `/v3/projects/f802179aedf84b1ea5d177c426ca11b2/users/a6b74cd24d334491b104e38593c9e096/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.149463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.150595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-39a469fd-5108-4b81-90fa-961942b010f7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.151812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-39a469fd-5108-4b81-90fa-961942b010f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.157566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f802179aedf84b1ea5d177c426ca11b2, user_id=a6b74cd24d334491b104e38593c9e096, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.158582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:36.158582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:37:36.158582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:37:36.160307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 779/1559] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.160549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72d9e3-db8a-44bf-bef6-c6f9a7e61a9f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.161497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33366c-c546-4d45-adda-fa6b7e4f6dfe None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.161781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33366c-c546-4d45-adda-fa6b7e4f6dfe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.162051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33366c-c546-4d45-adda-fa6b7e4f6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.174374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 781/1560] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:36 2022] PUT /identity/v3/projects/f802179aedf84b1ea5d177c426ca11b2/users/a6b74cd24d334491b104e38593c9e096/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:36.175377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.175698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.175965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.185017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0b33366c-c546-4d45-adda-fa6b7e4f6dfe None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.186266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0b33366c-c546-4d45-adda-fa6b7e4f6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.195329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.196528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.246099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 780/1561] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.247430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.247751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.248025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.257580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 782/1562] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.259285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.268890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d217-6d3a-4ddb-9fc6-7be5ba354d62 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.269058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.270137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.274022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.274600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.274880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.275150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.275786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.277687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.278924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 781/1563] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.279809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.289201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde41ce-0490-44f5-b8e5-ca6cce982366 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.295254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.296029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.296352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.296640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.297296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.299309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.303448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 783/1564] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.304304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.315241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feb74d-61dd-4ea4-bdad-766925a9d06a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.320492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.321077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.321362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.321627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.325147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 782/1565] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.325294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:36.325294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.325471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.325558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ed55b-de7f-4f0b-a5f4-afb23fa0ebb7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.333250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb01-5051-4d45-811b-cf26596a5322 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.337870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 784/1566] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:36.339176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.339461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.339763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.344835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.345439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.345712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.345979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.346668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:36.346966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.348611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5b7d-4d7f-4092-9c1e-7a20dc694147 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.365599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 783/1567] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:36.365599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.365599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.365599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.369271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] MFA Rules not processed for user `a6b74cd24d334491b104e38593c9e096`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.370473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.386539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.387969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.396038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 784/1568] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.396630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.405515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bb306-ed98-4a97-a99e-928a03a8be4a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.410240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.410812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.411088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.411355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.412063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:36.412360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.413933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ecf0-9678-4b1f-ab6a-0f23c3591159 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.425402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 785/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:36.426566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.426877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.427693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.440924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 785/1570] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.441787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.447488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:36.448707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:36.454954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18b4de-9284-4a15-8713-53f979620ab7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.456691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 786/1571] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:36.457443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.459936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.460545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.460804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.461078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.461715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.463304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.467295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e871f4-ec17-410d-92a2-871a84b300e4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.471919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.472497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.472773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.473042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.473154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 786/1572] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:36.473674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.473956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.475411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.483147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d32b6b-da3c-4cb2-9e31-ead14ad4e1f6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.488374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 787/1573] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:36.488374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.488606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.488606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.488606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.488871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.489461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.491922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.496091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256119-9548-403d-afbf-7257ddcf2f94 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.500580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.501154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.501428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.501697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.502298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.504191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.522521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 787/1574] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.522521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.535262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 788/1575] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.535874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.536009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.588911 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d1ec-463e-4e71-91b3-8f34d986a3c0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.592512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.595954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.596575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.596851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.597121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.597643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687ad0-7175-4601-893e-b64d32e94d4a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.597766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:36.598059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.599723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.605158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.605769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.606049 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.606322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.606954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.609524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.616191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 788/1576] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:36.616191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.625321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f939-2cca-4f83-b889-d864fad72b5a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.629837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.630981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.631254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.631522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.632269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.634392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.642043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 789/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.644494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.665395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 789/1578] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.665395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.710656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adc3d7-4085-4781-9abe-986bd53ccf26 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.726394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fda5e-53d4-42dc-a3ff-ad988f430af5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.731422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.732048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.732324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.732590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.733220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.734803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.745361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 790/1579] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:36.746259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.757807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef240e2f-b248-48b4-9062-c63a4a1a5393 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.762394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.762972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.763250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.763518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.764165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.765728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.767461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.768137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.768412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.768679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.769342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:36.769638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.771232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.775260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 791/1580] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:36.779287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.782599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 790/1581] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:36.783372 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.789439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956995dc-67aa-4118-ba4d-1e700f749587 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.794157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe71fd5-4c80-411a-b66e-f0cc9392790e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.794287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.794753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.795034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.795305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.795953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.797843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.798777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.799361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.799687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.799946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.800556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.803013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.819825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 792/1582] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.820605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.826261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 791/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.827044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.830076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc1ff8-f423-47ad-9897-718eb3ef6b8c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.835070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.835688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.835970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.836247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.836893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.838805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.839362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb087f4b-47ca-48c7-9202-6d6d3a022381 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.843941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.844523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.844806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.845076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.845683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.847611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.868323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 793/1584] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.869232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.874112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 792/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.874112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.883673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4d7b-9809-468c-a250-26060c722514 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.902990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.929417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:36.934378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b8a36-4273-4928-85a1-ab3b205928f7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.939363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.940025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.940298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.940574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.941230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.943165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.945512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:36.946174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:36.946452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:36.946725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] PATH_INFO: `/v3/projects/ba70534c51174be1b1be439eca1186ed/users/67e78bd56cb4460ea539dd61e973a8eb/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:36.962680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba70534c51174be1b1be439eca1186ed, user_id=67e78bd56cb4460ea539dd61e973a8eb, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:36.965401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:36.965699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 794/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:36.969298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:36.979357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1308cd-c3eb-444e-81e6-027dc84ecbfa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:36.979522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 793/1587] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:36 2022] PUT /identity/v3/projects/ba70534c51174be1b1be439eca1186ed/users/67e78bd56cb4460ea539dd61e973a8eb/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:36.980249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.041274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91507dcd-c42e-4e26-9a4e-56533229fa84 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.041504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.042028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.042307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.042582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] PATH_INFO: `/v3/projects/4c428129acc542788ca27402166ba7c9/users/de7098d28d8c462486928038c8a6a340/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.046067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.046669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.046949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.047246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.047895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.049800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.057644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c428129acc542788ca27402166ba7c9, user_id=de7098d28d8c462486928038c8a6a340, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.060791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.074655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 795/1588] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:36 2022] PUT /identity/v3/projects/4c428129acc542788ca27402166ba7c9/users/de7098d28d8c462486928038c8a6a340/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:37.075785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.076936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 794/1589] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:36 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.077900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.141338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe54fa5-874b-4ba9-a211-feb7de43b8bb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.142951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94420f1c-c5e6-4831-b172-1d3b1fc1541e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.146518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.147233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.147510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.147888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.148391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.148525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.149026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.149310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.149629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.150103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.150277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.151911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.160472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 796/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.161313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.165045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 795/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.165045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.175103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8d62-30b2-4edc-9efb-b6f8292da146 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.175293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123b6d-f80b-4a06-89a0-85efac649114 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.179720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.179960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.180312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.180543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.180647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.180823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.180942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.181149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.181480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.181766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.183336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.183448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a5b9-9a2f-454a-9397-09e10b1cf6e3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.193515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 796/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.194308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.204814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6882b-ac17-4f2e-9f7d-f924afcffdaa admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.207275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 797/1593] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.210748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.211359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.211838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.212105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.212297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.212566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.212745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.212843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.214400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.228506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 797/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.228506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.235550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec49f8-e933-4e66-88e3-799f2915f901 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.240204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.240784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.240889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] MFA Rules not processed for user `67e78bd56cb4460ea539dd61e973a8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:37.241062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.241339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.241949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.242065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:37.243870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2431-71d2-457b-b43b-2df3ee507497 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.251214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.265862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 798/1595] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/users => generated 296 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.267115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.267404 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.267710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.288808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.296771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] MFA Rules not processed for user `de7098d28d8c462486928038c8a6a340`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:37.298243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:37.311330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 798/1596] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:37.312169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.322195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf15ae-640b-4c20-92c4-5ca13a2bd3da None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.327069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.328004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.328284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.328555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.329190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.330771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.341529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 799/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.342486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.352514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff333cd-c19d-4be1-81e7-edd252558a71 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.357845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.358352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.358628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.358898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.359518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.361124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.366302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 799/1598] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:37.367711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.374510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 800/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.375416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.376982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51503-335c-49ea-ac81-cfd94026a32c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.382010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.382604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.382868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.383140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.383812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.385056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada310d-444a-4ffb-8535-debe52e8ba91 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.385396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.389837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.390423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.390705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.391011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.391670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.393264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.395343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 800/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.396660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.405799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd8d6-f7a8-44cb-9961-6e792d2c03fa admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.407518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 801/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.408470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.412801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.413428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.413702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.413969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] PATH_INFO: `/v3/projects/62c037515cb640efaef415547b7f6457/users/acf6037112bc4bc5b9722d36f183598c/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.418813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09296a7-2e19-4b7d-b892-73d52d874296 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.423493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.424100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.424377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.424653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.425271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.426826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.428423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c037515cb640efaef415547b7f6457, user_id=acf6037112bc4bc5b9722d36f183598c, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.431033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.437005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 802/1602] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.437781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.445195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 801/1603] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:37 2022] PUT /identity/v3/projects/62c037515cb640efaef415547b7f6457/users/acf6037112bc4bc5b9722d36f183598c/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:37.446059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.447873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebc80-0df2-45e5-bd71-e1836851b583 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.504626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.505722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.506004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.506286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.506909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.508840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.509871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79033b8-876c-4d7b-bafb-71aeb6b792fc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.514469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.515129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.515407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.515737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] PATH_INFO: `/v3/projects/458a894213fa47d78568eefbb75f05b3/users/d0aea5553e1043889571c50c3b01cacc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.530920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458a894213fa47d78568eefbb75f05b3, user_id=d0aea5553e1043889571c50c3b01cacc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.533612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.535957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 803/1604] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.536777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.549878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 802/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:37 2022] PUT /identity/v3/projects/458a894213fa47d78568eefbb75f05b3/users/d0aea5553e1043889571c50c3b01cacc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:37.551030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.588116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.600458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854e51-ae1e-46f9-8b70-46f759d52663 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.602234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.617208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39138228-325d-41ec-8734-dde0f10817c1 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.621924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.622587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.622870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.623142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] PATH_INFO: `/v3/projects/4a9a1d62cecd479e916fb67cf6d0d612/users/93b81cbad1554da3b1ad42575737b4f4/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.638926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9a1d62cecd479e916fb67cf6d0d612, user_id=93b81cbad1554da3b1ad42575737b4f4, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.641618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.655553 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 803/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:37 2022] PUT /identity/v3/projects/4a9a1d62cecd479e916fb67cf6d0d612/users/93b81cbad1554da3b1ad42575737b4f4/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:37.656380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.668019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.668692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.668972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.669243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.669866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.671819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.698329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 804/1607] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.699171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.727150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b3d0-9826-42ee-a74c-f55be9fc7518 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.760327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b4307-ab83-462b-97fe-9787935926b8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.765036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.765636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.765945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.766219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.766855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.768593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.778899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 805/1608] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.779868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.785188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.785845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.786583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.786583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] PATH_INFO: `/v3/projects/aec3a96984084453b5e3e7f3e826f694/users/d6bdc20813694b0db5ca39069974b036/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.789726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62efb9-ea37-47aa-8343-ea851d9ce2c3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.794286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.794891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.795136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.795398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.796058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.797745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.800881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec3a96984084453b5e3e7f3e826f694, user_id=d6bdc20813694b0db5ca39069974b036, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.803794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.809387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 806/1609] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.810532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.818895 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:37 2022] PUT /identity/v3/projects/aec3a96984084453b5e3e7f3e826f694/users/d6bdc20813694b0db5ca39069974b036/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:37.819746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.821708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3601d3-25d1-436c-8b67-48fdd7a773f9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.879318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.879950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.880851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.881123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.881755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.882777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176f60-278d-452d-b09f-20b025a693f8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.883335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c282e-5ece-40bd-b789-1995d0792a00 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.887484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.888111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.888393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.888665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.889277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.891178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c87f7-9e52-4a40-825a-186c01e4132f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.893108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 807/1611] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:37.894408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.894758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.895099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.899994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.908738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:37.915820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 805/1612] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.915820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.916085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:37.916200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.916200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.916417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:37.923513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 808/1613] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:37.924283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.933884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6adf63-d796-4208-953b-13bb4812a312 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.939133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.939761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.940038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.940311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.940931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:37.942173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] MFA Rules not processed for user `93b81cbad1554da3b1ad42575737b4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:37.943437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:37.943967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:37.966085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 809/1614] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:37.966975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:37.976418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe72c-415c-4a2d-9f62-92d3e83e9829 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:37.981069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:37.981699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:37.981974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:37.982883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] PATH_INFO: `/v3/projects/db908214d6fb40909a4728b207bf776a/users/51def7315f294e99ba206f5db1ef282f/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:37.997550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db908214d6fb40909a4728b207bf776a, user_id=51def7315f294e99ba206f5db1ef282f, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.000269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa28eee-4456-4381-b447-132b061f5246 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.011091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 806/1615] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.011931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.018790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 810/1616] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:37 2022] PUT /identity/v3/projects/db908214d6fb40909a4728b207bf776a/users/51def7315f294e99ba206f5db1ef282f/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:38.020610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.021207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.021770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.021982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e96ff-bf8f-44e2-b544-a11d77a9f037 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.053067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] MFA Rules not processed for user `d6bdc20813694b0db5ca39069974b036`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.054240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.082166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.083242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.083602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.083878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] PATH_INFO: `/v3/projects/2f3596b4a1404d3db340943fbd63567d/users/f051f99404fc4e0593553ae95e1f90d5/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.097904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3596b4a1404d3db340943fbd63567d, user_id=f051f99404fc4e0593553ae95e1f90d5, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.100678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.113308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 807/1617] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:38 2022] PUT /identity/v3/projects/2f3596b4a1404d3db340943fbd63567d/users/f051f99404fc4e0593553ae95e1f90d5/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:38.116336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.120017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 811/1618] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.120017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.132522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f168b8-0196-44c9-a2a0-3c1480677bdc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.188457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a356-1e0b-4363-a386-bb9855de34e2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.193799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.194454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.194735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.195005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] PATH_INFO: `/v3/projects/62c037515cb640efaef415547b7f6457/users/acf6037112bc4bc5b9722d36f183598c/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.195402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.196047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.196327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.196603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.196930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c037515cb640efaef415547b7f6457, user_id=acf6037112bc4bc5b9722d36f183598c, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.197242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.198862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.199591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.205209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.209935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 812/1619] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:38.210737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.219165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 808/1620] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:38 2022] PUT /identity/v3/projects/62c037515cb640efaef415547b7f6457/users/acf6037112bc4bc5b9722d36f183598c/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:38.219165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.220538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.266741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.278145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bbbba-2b56-4261-b1d3-3870deecd35d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.282177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def9bc-ae4f-4ed7-b8b8-ba3c22921b86 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.287267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.287917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.288190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.288463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.289096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.290698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4df37-a7fb-43a7-86cd-c72cb84f14a6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.300503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 809/1621] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:38.301476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d197d-c02a-4530-bf4c-68a947366dcc None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.301754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d197d-c02a-4530-bf4c-68a947366dcc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.302042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d197d-c02a-4530-bf4c-68a947366dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.321649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-3e9d197d-c02a-4530-bf4c-68a947366dcc None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.322770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3e9d197d-c02a-4530-bf4c-68a947366dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.327326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.327966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.328285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.328510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.330533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 810/1622] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.331754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2d63-aeb3-4ddb-8594-7fa186741054 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.331990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2d63-aeb3-4ddb-8594-7fa186741054 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.332258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2d63-aeb3-4ddb-8594-7fa186741054 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.333899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 811/1623] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 17 08:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:38.334716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb41f6-230e-499d-b990-f1932b56e613 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.334991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb41f6-230e-499d-b990-f1932b56e613 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.335255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb41f6-230e-499d-b990-f1932b56e613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.342901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.344358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137689-0415-4980-9f0f-0ff76b519ea7 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.354288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e4eb41f6-230e-499d-b990-f1932b56e613 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.354458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 813/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:38.355766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf3af-468e-4e16-aa1e-73fc4fa9e90e None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.356144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf3af-468e-4e16-aa1e-73fc4fa9e90e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.356429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf3af-468e-4e16-aa1e-73fc4fa9e90e None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.357143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e4eb41f6-230e-499d-b990-f1932b56e613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.357822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 814/1625] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 17 08:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:38.358399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf3af-468e-4e16-aa1e-73fc4fa9e90e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.370443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 812/1626] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.371698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089992b2-3ccf-4a81-b41c-605699d34f96 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.371985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089992b2-3ccf-4a81-b41c-605699d34f96 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.372260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089992b2-3ccf-4a81-b41c-605699d34f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.373987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf3af-468e-4e16-aa1e-73fc4fa9e90e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.379823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.380812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.381091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.381364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] PATH_INFO: `/v3/projects/031de409116e46e691083e0ea1f1489f/users/815cc7adb60146f692b349038d05f306/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.398606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031de409116e46e691083e0ea1f1489f, user_id=815cc7adb60146f692b349038d05f306, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.401249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-089992b2-3ccf-4a81-b41c-605699d34f96 None None] MFA Rules not processed for user `acf6037112bc4bc5b9722d36f183598c`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.401548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.402490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-089992b2-3ccf-4a81-b41c-605699d34f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.416554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 815/1627] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:38 2022] PUT /identity/v3/projects/031de409116e46e691083e0ea1f1489f/users/815cc7adb60146f692b349038d05f306/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:38.417957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.488468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b028f-187d-41be-ba0f-92044e6300e3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.491086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 813/1628] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.492385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401fc87-22be-408b-bf75-870e99cd647b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.492666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401fc87-22be-408b-bf75-870e99cd647b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.492933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401fc87-22be-408b-bf75-870e99cd647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.500582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.501272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.501554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.501829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] PATH_INFO: `/v3/projects/3d91a20001b645d1b165eec373101907/users/a14e962cbc514772a953a77192ac7a67/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.522214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d91a20001b645d1b165eec373101907, user_id=a14e962cbc514772a953a77192ac7a67, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.525806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.534810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f401fc87-22be-408b-bf75-870e99cd647b None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.536202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f401fc87-22be-408b-bf75-870e99cd647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.542274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 816/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:38 2022] PUT /identity/v3/projects/3d91a20001b645d1b165eec373101907/users/a14e962cbc514772a953a77192ac7a67/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:38.543591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.597612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.625115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a600-c7ec-4638-97ef-c8b399db913a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.626272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 814/1630] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.627591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.627873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.628144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.637234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.638105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.638682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.639116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.649168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:38.650479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:38.655332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.660788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 815/1631] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 17 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:38.662161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.676035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329ebc1-f80d-474c-80d1-9f74d845ed4f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.680422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.681038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.681322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.681595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.718359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.719862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.731427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 817/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:38.732315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.742347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308b7c8-c380-4388-a7ab-1d34447da81f service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.752910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.753531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.754336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.754616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.755292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.756333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.757561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.757963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.775455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 818/1633] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:38.775455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.778492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 816/1634] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:38.779499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.792933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62fbe2-827a-4ae6-9c3e-102b21e2bd32 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.798205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.799021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.799366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.799682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.800389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.802012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.814587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 817/1635] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:38.815422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.834870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f0de4-b6e9-4f81-8eb8-e900d487746a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.843113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.845126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.846403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.846623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.861584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195e69e-f175-46b5-86de-73b1675b8f4c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.867251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.869054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:38.869546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:38.869983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:38.926232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:38.928980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:38.955416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 818/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:38.957330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:38.985478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd842e6-c8b2-4616-924e-774092c0a57d service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:38.998529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:38.999753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.001140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.001562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.014215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.022166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.043657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 819/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:39.046801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:39.084758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a124372-dc3a-4adb-b185-0649f0d39186 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:39.095563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:39.096242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.096516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.097364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] PATH_INFO: `/v3/projects/031de409116e46e691083e0ea1f1489f/users/815cc7adb60146f692b349038d05f306/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.104002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031de409116e46e691083e0ea1f1489f, user_id=815cc7adb60146f692b349038d05f306, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.106567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.127477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 820/1638] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:39 2022] PUT /identity/v3/projects/031de409116e46e691083e0ea1f1489f/users/815cc7adb60146f692b349038d05f306/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:39.128324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:39.139613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.143277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae9a1a-b2b8-4314-8b28-3033f12ec156 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.150631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:39.165139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 819/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:39.169693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4115f-5952-45a7-844d-4354058ad503 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.170179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4115f-5952-45a7-844d-4354058ad503 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.170815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4115f-5952-45a7-844d-4354058ad503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.226863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:39.241384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0ee4115f-5952-45a7-844d-4354058ad503 None None] MFA Rules not processed for user `815cc7adb60146f692b349038d05f306`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:39.246053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ee4115f-5952-45a7-844d-4354058ad503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:39.263867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01d6c7-d1ff-41a0-8ba5-a9ea9f330e47 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:39.286041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:39.286784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.287059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.287331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] PATH_INFO: `/v3/projects/3d91a20001b645d1b165eec373101907/users/a14e962cbc514772a953a77192ac7a67/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.289353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d91a20001b645d1b165eec373101907, user_id=a14e962cbc514772a953a77192ac7a67, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.292059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.312686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 821/1640] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:39 2022] PUT /identity/v3/projects/3d91a20001b645d1b165eec373101907/users/a14e962cbc514772a953a77192ac7a67/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:39.313628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:39.420921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 820/1641] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:39.422659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456711e-b73c-4a7b-a38c-1697d17da67a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.423188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456711e-b73c-4a7b-a38c-1697d17da67a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.423571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456711e-b73c-4a7b-a38c-1697d17da67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.428552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baabf2e-39eb-4192-aea0-ffc18ba20eb7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:39.439160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:39.439833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.440111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.440381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.472655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e456711e-b73c-4a7b-a38c-1697d17da67a None None] MFA Rules not processed for user `a14e962cbc514772a953a77192ac7a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:39.472655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e456711e-b73c-4a7b-a38c-1697d17da67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:39.579340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.580810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.595634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 822/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:39.596618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:39.609087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b5d3-0e93-4fcc-8d18-222629635fdb service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:39.613605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:39.615123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.615652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.616142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.668380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 821/1643] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:39.673431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6017-c505-4214-9811-6f67bc889819 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.673839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6017-c505-4214-9811-6f67bc889819 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.674653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6017-c505-4214-9811-6f67bc889819 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.677462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 822/1644] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 17 08:37:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:39.678785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e369-82c9-4356-b4c6-ff9e1e16b9e4 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.680618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e369-82c9-4356-b4c6-ff9e1e16b9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.681718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e369-82c9-4356-b4c6-ff9e1e16b9e4 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.685594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 823/1645] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 17 08:37:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:39.691137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.692452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.694229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.725367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.732778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbfb1d-3e0e-41b8-9ea6-8af49b1df1af service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.746548 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:39.748981 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:39.755225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 823/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:39.758846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.760298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.760578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.800840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:39.801993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:39.839759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:39.873224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:39.893100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 824/1647] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:39.894107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:39.905057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31269a8e-0991-4fc1-b5e5-39499d759920 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:39.909107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:39.909830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:39.910288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:39.910569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:39.921334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:39.923647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:39.949051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 825/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:39.962639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 824/1649] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:40.065192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:40.074119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d359105-debd-4b5a-bd4a-bd51dd557d1c service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:40.077874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:40.093040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f425e72-c04c-416d-ad01-6b94c149066d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:40.094445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:40.095083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:40.095358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:40.095693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:40.107405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:40.109860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:40.111956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:40.112461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:40.131559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:40.135820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:40.139013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:40.141218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:40.166130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 826/1650] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:40.180989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 825/1651] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:40.964445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:40.975018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6d95-d4ac-4621-bd1e-6fe9ada0864d service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:40.979276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:40.980098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:40.980376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:40.980650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:41.091515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:41.093745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcdba6-67cf-4d30-a7e3-ee27f6613586 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:41.119320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 827/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:41.368162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:41.533625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea75bb-909c-4e61-8729-125ecf764cbc service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:41.539403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:41.540258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:41.540544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:41.540822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] PATH_INFO: `/v3/users/93b81cbad1554da3b1ad42575737b4f4` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:41.542365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b81cbad1554da3b1ad42575737b4f4)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:41.543660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: WARNING py.warnings [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:41.543660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: warnings.warn(msg) Aug 17 08:37:41.543660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: Aug 17 08:37:41.545743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:41.664033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b81cbad1554da3b1ad42575737b4f4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:41.692823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b81cbad1554da3b1ad42575737b4f4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:41.694074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b81cbad1554da3b1ad42575737b4f4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:41.710229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b81cbad1554da3b1ad42575737b4f4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:41.711398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b81cbad1554da3b1ad42575737b4f4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:41.735628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 826/1653] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:41 2022] DELETE /identity/v3/users/93b81cbad1554da3b1ad42575737b4f4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:41.741827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:41.742446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:41.744139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:41.777395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:41.779392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:41.885821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 828/1654] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:41.895161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:41.899954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:41.931564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:41.995940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc09a-bab4-4c94-b6fc-b3e473345e42 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:42.000478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:42.001407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:42.001695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:42.002884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:42.016418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:42.018136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f547b-fc01-4499-9622-de5ee51f66d2 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:42.053283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 827/1655] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:42.166551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:42.169886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:42.195042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5901c-3e1a-48dc-a6c6-4ec46f53dc9d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:42.213825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:42.214877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:42.215861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:42.216434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] PATH_INFO: `/v3/users/67e78bd56cb4460ea539dd61e973a8eb` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:42.221755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e78bd56cb4460ea539dd61e973a8eb)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:42.227189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:42.358316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e78bd56cb4460ea539dd61e973a8eb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:42.388207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e78bd56cb4460ea539dd61e973a8eb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:42.394653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:42.412780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e78bd56cb4460ea539dd61e973a8eb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:42.415059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e78bd56cb4460ea539dd61e973a8eb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:42.451514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e78bd56cb4460ea539dd61e973a8eb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:42.478051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 829/1656] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:42 2022] DELETE /identity/v3/users/67e78bd56cb4460ea539dd61e973a8eb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:42.481478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:42.482343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:42.482801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:42.514119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:42.517790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:42.686822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 828/1657] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:42.789351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:42.791486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:42.947417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db50501-456d-4c69-bcae-a830f92e3218 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:42.964093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:42.968215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:42.969567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:42.975645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:43.020041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:43.021990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bad64-3dd9-421b-ac2c-0eee2968cfeb service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:43.067534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 830/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:43.664695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:43.666772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:43.683287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295582e0-9b1d-4fc4-ac78-7b1e0ad36197 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:43.705679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:43.706655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:43.707112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:43.707604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] PATH_INFO: `/v3/projects/4a9a1d62cecd479e916fb67cf6d0d612` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:43.710006 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9a1d62cecd479e916fb67cf6d0d612)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:43.712603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:43.878274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9a1d62cecd479e916fb67cf6d0d612', 'request_id': 'req-c3afaa66-39fe-4322-9956-8834f5ff2a5a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:43.901735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9a1d62cecd479e916fb67cf6d0d612', 'request_id': 'req-c3afaa66-39fe-4322-9956-8834f5ff2a5a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:43.922533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9a1d62cecd479e916fb67cf6d0d612', 'request_id': 'req-c3afaa66-39fe-4322-9956-8834f5ff2a5a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:43.955295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] The token cache is being invalidate because project 4a9a1d62cecd479e916fb67cf6d0d612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:43.955639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:43.959428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c3afaa66-39fe-4322-9956-8834f5ff2a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:43.962420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 829/1659] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:43 2022] DELETE /identity/v3/projects/4a9a1d62cecd479e916fb67cf6d0d612 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:43.967163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:43.968025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:43.968439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.000249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:44.001775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:44.148141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 831/1660] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:44.157099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.157585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.158447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.225681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:44.228794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:44.263115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 830/1661] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:44.268704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.283506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b867d1-322f-4a8e-9929-9a6378debae8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.318891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.321491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.321876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.322252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.323964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:44.324860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:44.329768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:44.365792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 832/1662] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:44.369623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.390643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4227-8ace-4741-af0b-8826af5cdc09 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.410399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.411031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.411873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.412150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.412791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:44.422473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:44.498530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 831/1663] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:44 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:44.503117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.521246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d7e6-e407-4f56-9513-fe67b1ae246f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.750376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.751050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.751331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.751628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.752266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:44.756647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:44.820918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 833/1664] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:44 2022] POST /identity/v3/users => generated 303 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:44.825131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.840741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e0581-5320-49ce-828c-78a394e9288a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.861231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.861881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.862162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.862436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.863090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:44.865293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:44.883506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 832/1665] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:44.884631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.891229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:44.901899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f8e0-29e9-468b-bdc4-4635a84e0994 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.912320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.913343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.913943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.915937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:44.915937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:44.917504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:44.954308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 834/1666] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:44.960274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:44.966795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:44.980297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2ff6-5940-474a-b9db-c92026afc450 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:44.993958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:44.994656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:44.994937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:44.995211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] PATH_INFO: `/v3/projects/17b927241d854173a20563b0f91c9331/users/ef1faf6f37894b9ca695b0129b74bbcc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.002095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.008142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.066031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ba37-e6f5-44b6-af47-332ec4776965 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.088804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.089471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.089751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.090023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] PATH_INFO: `/v3/users/d6bdc20813694b0db5ca39069974b036` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.102259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bdc20813694b0db5ca39069974b036)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.104726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.109968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b927241d854173a20563b0f91c9331, user_id=ef1faf6f37894b9ca695b0129b74bbcc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.114137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571668-bca2-4d0d-80f8-f668afbf75e4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.178944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 833/1667] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:44 2022] PUT /identity/v3/projects/17b927241d854173a20563b0f91c9331/users/ef1faf6f37894b9ca695b0129b74bbcc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:45.190715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.192352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.193136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.230202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bdc20813694b0db5ca39069974b036'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.257114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bdc20813694b0db5ca39069974b036'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.283979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bdc20813694b0db5ca39069974b036'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.284896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bdc20813694b0db5ca39069974b036'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.304229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-12ee6833-20f6-4fee-821d-9fb44b886b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bdc20813694b0db5ca39069974b036'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.320787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] MFA Rules not processed for user `ef1faf6f37894b9ca695b0129b74bbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:45.322121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.326239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 835/1668] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:45 2022] DELETE /identity/v3/users/d6bdc20813694b0db5ca39069974b036 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:45.330391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.335782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.336204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.405461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:45.413119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.564367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 834/1669] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:45.571913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.573461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.575432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 836/1670] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:45.586215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.587714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.592176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c98eb-be59-42bf-a657-3dd925ad489a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.598418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.600320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.600606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.600877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.601716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.603978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.670434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 835/1671] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:45 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:45.672374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.718047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc5eec-8838-4349-aa85-3c9f20591c60 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.755817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:45.763183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f4322-ddc0-4f59-8220-c9eb0e3a81e9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.768986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.769841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.771289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.772541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.772541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.776843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.828294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.828931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.829214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.829485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.833599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 836/1672] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:45 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:45.834749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.836610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:45.850202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.851706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.856129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab064b-010f-4070-90c4-b27a02384475 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.862881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.865022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.865400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.865708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] PATH_INFO: `/v3/projects/ba70534c51174be1b1be439eca1186ed` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.867224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba70534c51174be1b1be439eca1186ed)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.869847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.877358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 837/1673] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:45.877868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.893777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378e209-8dcf-4748-a96e-fc0b2f617664 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.909888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:45.910679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:45.910967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:45.911819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:45.912480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:45.914090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:45.934327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 838/1674] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:45.938458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:45.944487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:45.963288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8831c-26a3-4456-ab05-dc7957c6beee admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:45.966568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba70534c51174be1b1be439eca1186ed', 'request_id': 'req-5a0d21c5-18fd-425b-a7bc-83a64be93db3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.976148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba70534c51174be1b1be439eca1186ed', 'request_id': 'req-5a0d21c5-18fd-425b-a7bc-83a64be93db3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:45.992862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba70534c51174be1b1be439eca1186ed', 'request_id': 'req-5a0d21c5-18fd-425b-a7bc-83a64be93db3'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.023271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] The token cache is being invalidate because project ba70534c51174be1b1be439eca1186ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:46.023610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.025937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.034156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 837/1675] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:45 2022] DELETE /identity/v3/projects/ba70534c51174be1b1be439eca1186ed => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:46.035152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:46.053775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:46.090828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:46.091917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.091917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.092123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] PATH_INFO: `/v3/projects/ccfc808142fe4128831f16730a17f762/users/56eb83431b1a4176bd583d88dde23d67/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:46.142138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfc808142fe4128831f16730a17f762, user_id=56eb83431b1a4176bd583d88dde23d67, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:46.144938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:46.172222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 839/1676] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:45 2022] PUT /identity/v3/projects/ccfc808142fe4128831f16730a17f762/users/56eb83431b1a4176bd583d88dde23d67/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:37:46.176431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:46.179740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:46.211902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d21c5-18fd-425b-a7bc-83a64be93db3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:46.321395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30368-115c-4d28-bdad-2c9cd199a516 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:46.331480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:46.332310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.332598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.333181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:46.334527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:46.342876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:46.363908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 840/1677] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:46.374997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:46.386972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:46.387668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.387948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.388217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] PATH_INFO: `/v3/users/815cc7adb60146f692b349038d05f306` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:46.389429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=815cc7adb60146f692b349038d05f306)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:46.392138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:46.417911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938abec-40a2-41cf-8678-3cf18b7ae59b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:46.432114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:46.433613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.434099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.434644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] PATH_INFO: `/v3/projects/ccfc808142fe4128831f16730a17f762/users/56eb83431b1a4176bd583d88dde23d67/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:46.446505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfc808142fe4128831f16730a17f762, user_id=56eb83431b1a4176bd583d88dde23d67, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:46.449374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40df847-e7c9-4ca0-b1f0-d7e7cffa5fba admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:46.480013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 841/1678] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:46 2022] PUT /identity/v3/projects/ccfc808142fe4128831f16730a17f762/users/56eb83431b1a4176bd583d88dde23d67/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:46.492723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.493145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.493436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:46.509334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815cc7adb60146f692b349038d05f306'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.548014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815cc7adb60146f692b349038d05f306'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.550178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815cc7adb60146f692b349038d05f306'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.553043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] MFA Rules not processed for user `56eb83431b1a4176bd583d88dde23d67`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:46.560508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:46.561426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:46.569998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815cc7adb60146f692b349038d05f306'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.571598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815cc7adb60146f692b349038d05f306'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:46.612106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:46.628384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 838/1679] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:46 2022] DELETE /identity/v3/users/815cc7adb60146f692b349038d05f306 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:46.799006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 842/1680] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:46.811089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:46.812842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:46.966045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0fff-5f06-4543-acab-b8ca372a1311 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:46.972233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:46.972862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:46.973241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:46.973539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.097950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:47.099773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:47.128764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 839/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:47.154693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:47.156475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.313408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7051a5-f47d-4f9d-8acc-47c78b92ef8b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:47.354416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:47.356010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.477979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:47.482649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:47.482869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:47.483144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] PATH_INFO: `/v3/projects/031de409116e46e691083e0ea1f1489f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.490586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=031de409116e46e691083e0ea1f1489f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:47.491678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: WARNING py.warnings [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:37:47.491678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: warnings.warn(msg) Aug 17 08:37:47.491678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: Aug 17 08:37:47.493164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:47.542562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd52d1d-220d-42fe-b98f-e9fad30ac040 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:47.551222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:47.552474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:47.552752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:47.553022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] PATH_INFO: `/v3/users/ef1faf6f37894b9ca695b0129b74bbcc` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.555633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1faf6f37894b9ca695b0129b74bbcc)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:47.557458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:47.582680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031de409116e46e691083e0ea1f1489f', 'request_id': 'req-ac526442-2c49-4ec1-bf46-a985a7753dcf'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.615007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:47.622907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031de409116e46e691083e0ea1f1489f', 'request_id': 'req-ac526442-2c49-4ec1-bf46-a985a7753dcf'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.640223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031de409116e46e691083e0ea1f1489f', 'request_id': 'req-ac526442-2c49-4ec1-bf46-a985a7753dcf'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.655496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:47.672656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1faf6f37894b9ca695b0129b74bbcc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.681013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] The token cache is being invalidate because project 031de409116e46e691083e0ea1f1489f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:47.683354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.684833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac526442-2c49-4ec1-bf46-a985a7753dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.688317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 843/1682] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:47 2022] DELETE /identity/v3/projects/031de409116e46e691083e0ea1f1489f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:47.693205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1faf6f37894b9ca695b0129b74bbcc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.693934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1faf6f37894b9ca695b0129b74bbcc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.694862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:47.695319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:47.696152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.713546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1faf6f37894b9ca695b0129b74bbcc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.714088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-471b9393-3285-43e0-b39c-7be88db6127a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1faf6f37894b9ca695b0129b74bbcc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:47.741299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 840/1683] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:47 2022] DELETE /identity/v3/users/ef1faf6f37894b9ca695b0129b74bbcc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:37:47.745591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:47.745870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:47.746144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.749883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:47.753726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.783121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:47.784151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.910589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 841/1684] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:37:47.912171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:47.915494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.919907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 844/1685] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:37:47.922730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:47.927625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:47.932805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df840d8-4fb6-4249-893d-f5bc27598a4c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:47.941320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:47.942184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:47.943027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:47.943453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] PATH_INFO: `/v3/projects/aec3a96984084453b5e3e7f3e826f694` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:47.945149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec3a96984084453b5e3e7f3e826f694)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:47.947874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.038415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec3a96984084453b5e3e7f3e826f694', 'request_id': 'req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:48.047027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec3a96984084453b5e3e7f3e826f694', 'request_id': 'req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:48.067027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec3a96984084453b5e3e7f3e826f694', 'request_id': 'req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:48.074923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6e825-2491-46db-b81b-f18c1c734c72 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.123230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] The token cache is being invalidate because project aec3a96984084453b5e3e7f3e826f694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:48.123523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:48.130759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fd47eeeb-cdee-4f46-ae38-87852a1d0bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:48.150945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 842/1686] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:47 2022] DELETE /identity/v3/projects/aec3a96984084453b5e3e7f3e826f694 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:48.150945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b1939-16ee-40ab-93af-9e2bad70ba2b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.150945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b1939-16ee-40ab-93af-9e2bad70ba2b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.150945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b1939-16ee-40ab-93af-9e2bad70ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.180382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-020b1939-16ee-40ab-93af-9e2bad70ba2b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:48.182377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-020b1939-16ee-40ab-93af-9e2bad70ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:48.219456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.222239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.222523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.222811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.226462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:48.268371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:48.305015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 843/1687] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:48.306518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4203cd-133d-43f0-bdae-fcf9e407c059 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.306967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4203cd-133d-43f0-bdae-fcf9e407c059 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.307252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4203cd-133d-43f0-bdae-fcf9e407c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.320351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:48.341255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.343322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.348242 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9f4203cd-133d-43f0-bdae-fcf9e407c059 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:48.349984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9f4203cd-133d-43f0-bdae-fcf9e407c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:48.362328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 845/1688] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:48.362515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 844/1689] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:48.364634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.371982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.372272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.372593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.378493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77abcd-bf7e-4b2f-9a58-1211d2314d88 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.402972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.403689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.403969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.404281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.407347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:48.408147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:48.408467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.408682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:48.412377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.423038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 845/1690] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:48.424761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.438696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b3f9-cab9-4e07-9cec-c3fc568d6122 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.449257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.451091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.451686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 846/1691] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:48.451788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.452033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.452848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:48.453221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.458167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.458754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.483519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c163-4e97-48ae-810c-1be54338a0d3 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.502444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.502853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 846/1692] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:48.504325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.504640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.506054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.507278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.508326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.514843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.527625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5fcd-7012-42e3-ab2f-80ff7df593a5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.534346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.535014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.535292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.535617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.536796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.544369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.612296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 847/1693] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:48.617639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.622345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 847/1694] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:48.624322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.794015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f862-7bdb-4e91-b3ea-13581337c8f8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.807030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce162c-0604-4631-8666-bbb64502ecd3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.812389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.813181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.813330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.813570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.814210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.816370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.817218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.817865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.818144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.818413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.819895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.821877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.876597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 848/1695] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:48.881683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.887568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 848/1696] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:48 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:37:48.892213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.900671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eff3d3-7d73-4946-9920-602e32d35429 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.915176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.916293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.916574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.916841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.918343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7c8a3-e995-49b9-b802-7a16bc55f7b8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:48.920633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.922376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.937902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:48.938379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:48.938667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:48.938935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:48.939711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:48.941297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:48.952181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 849/1697] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:37:48.966853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.979095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 849/1698] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:37:48.983738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:48.995521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0e8f-994d-488c-95d1-744cfbdac8ef admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.006057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.006769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.007097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.007534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.008267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.014629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.015601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd55bd-f77b-4342-ab27-5439f476c52c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.033460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 850/1699] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:49.034591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.034786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.035367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.036615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.036615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.037127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.037328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.040351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.060882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f80dc-dcf5-463b-9bce-deb2a12fcd44 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.069864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.070817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.071266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.071970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] PATH_INFO: `/v3/projects/17b927241d854173a20563b0f91c9331` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.075515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b927241d854173a20563b0f91c9331)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.077646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.078605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 850/1700] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:37:49.079444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.110010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2346-68a7-4330-83d5-cb3b676de8f5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.128483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.129217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.129502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.129812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] PATH_INFO: `/v3/projects/7ee34cbec3304fa2ac876bfe824fa904/users/f585ee361b6f4e43a19fb2ede20b1338/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.150400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b927241d854173a20563b0f91c9331', 'request_id': 'req-93c12100-9cd0-4047-af74-77490789c7e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.156716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:49.160302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b927241d854173a20563b0f91c9331', 'request_id': 'req-93c12100-9cd0-4047-af74-77490789c7e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.163484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee34cbec3304fa2ac876bfe824fa904, user_id=f585ee361b6f4e43a19fb2ede20b1338, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.166555 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.182653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b927241d854173a20563b0f91c9331', 'request_id': 'req-93c12100-9cd0-4047-af74-77490789c7e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.189150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 851/1701] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:49 2022] PUT /identity/v3/projects/7ee34cbec3304fa2ac876bfe824fa904/users/f585ee361b6f4e43a19fb2ede20b1338/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:49.190010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.206794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] The token cache is being invalidate because project 17b927241d854173a20563b0f91c9331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:49.207098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.209649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-93c12100-9cd0-4047-af74-77490789c7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.211893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 851/1702] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:49 2022] DELETE /identity/v3/projects/17b927241d854173a20563b0f91c9331 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:49.216597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.216880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.217163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.269511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] MFA Rules not processed for user `f585ee361b6f4e43a19fb2ede20b1338`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:49.271191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.328447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:49.333502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b4ba-bc6a-493c-abdc-ecfe1a5f13d8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.351438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.352159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.352448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.352757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] PATH_INFO: `/v3/projects/2bbb3bf890154e42bdba7d5ed9d811f9/users/d8125639c56c44c5a749e027d917277d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.400529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 852/1703] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:49.400529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.403395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.416782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbb3bf890154e42bdba7d5ed9d811f9, user_id=d8125639c56c44c5a749e027d917277d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.419460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.431568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff3b1f-1d47-4ea0-8523-e0ddf2e4b63e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.439477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 852/1704] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:49 2022] PUT /identity/v3/projects/2bbb3bf890154e42bdba7d5ed9d811f9/users/d8125639c56c44c5a749e027d917277d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:49.440353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.442109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.564272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.564978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.565280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.565503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] PATH_INFO: `/v3/users/56eb83431b1a4176bd583d88dde23d67` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.573944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56eb83431b1a4176bd583d88dde23d67)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.576756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.623151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073845-137c-41d1-927c-0de3b9b9036b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:49.628135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:49.628763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.629045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.629312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.630537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:49.632526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9518f3-de7b-409c-8130-27ffacd33329 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:49.694037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56eb83431b1a4176bd583d88dde23d67'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.704983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 853/1705] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:49.706325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:49.709062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:49.709359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:49.728463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56eb83431b1a4176bd583d88dde23d67'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.728818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56eb83431b1a4176bd583d88dde23d67'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.754502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56eb83431b1a4176bd583d88dde23d67'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.755714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56eb83431b1a4176bd583d88dde23d67'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:49.760160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:49.792893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 853/1706] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:49 2022] DELETE /identity/v3/users/56eb83431b1a4176bd583d88dde23d67 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:49.794990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.798909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] MFA Rules not processed for user `d8125639c56c44c5a749e027d917277d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:49.802238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.813295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:49.925503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 854/1707] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:49.931262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:49.952280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:50.021520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36b93c-6acc-48ef-8bde-1cf3c33648c1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.037992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.039721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.040487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.041265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.044023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.046252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.096756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 854/1708] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:49 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:50.099961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.102097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:50.115361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fade6d-d5c1-4be1-ac83-b8f8bf07e0f7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.115849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8c19-fc29-48b9-884b-26c857f37a4e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.121668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.122428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.122812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.123253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.124121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.125933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.126566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.126840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.127110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.127763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.129326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.130214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.147609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 855/1709] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:50.157566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.175344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4958-4068-4fca-8272-344a3d1c20e8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.184507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.188744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.189406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.189518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] PATH_INFO: `/v3/projects/cb81922381144362a90fee0ee2b8fa9d/users/c747da85f9d74dffa1df79b9ca176e2d/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.194060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 855/1710] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:49 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:50.195343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.227424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb81922381144362a90fee0ee2b8fa9d, user_id=c747da85f9d74dffa1df79b9ca176e2d, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.252338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.287481 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 856/1711] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:50 2022] PUT /identity/v3/projects/cb81922381144362a90fee0ee2b8fa9d/users/c747da85f9d74dffa1df79b9ca176e2d/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:50.296057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de9a8c-f748-42b5-9a9c-e875a1d5bb4d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.307534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.509078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.509801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.510082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.510348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.511005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.530652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.586750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f3d7-7790-4934-80e1-944c946aa8aa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.590374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 856/1712] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:50 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:50.592865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.595498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.596525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.596907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.597281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.598042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.602013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.624196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa5c76-69e3-419f-98e0-6460d15ddeba admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.642030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.643192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.643192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.643441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.644045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.647711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.654724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 857/1713] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:50.656035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.690430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 857/1714] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:50.692077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.714040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386563-2f75-407d-a62a-1d6ca31686ab admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.729795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.730857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.730857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.731017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] PATH_INFO: `/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc/users/5a3d9b000a7d44ec9629110fe69e1e79/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.742478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f9c0-0289-4458-8bca-0e02203417f1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:50.770947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:50.771721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.772010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.772288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] PATH_INFO: `/v3/projects/cb81922381144362a90fee0ee2b8fa9d/users/c747da85f9d74dffa1df79b9ca176e2d/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.779596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e583bd775ae44fb2b8788a2c75d10bdc, user_id=5a3d9b000a7d44ec9629110fe69e1e79, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.785985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.791005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb81922381144362a90fee0ee2b8fa9d, user_id=c747da85f9d74dffa1df79b9ca176e2d, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:50.793782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72de4-a830-4559-b7de-c48400ee7fd9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:50.821618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 858/1715] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:50 2022] PUT /identity/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc/users/5a3d9b000a7d44ec9629110fe69e1e79/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:50.829011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 858/1716] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:50 2022] PUT /identity/v3/projects/cb81922381144362a90fee0ee2b8fa9d/users/c747da85f9d74dffa1df79b9ca176e2d/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:50.841182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:50.845455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:50.845738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:50.846415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:50.954004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] MFA Rules not processed for user `c747da85f9d74dffa1df79b9ca176e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:50.955480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:50.977543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:51.042998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:51.043860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df4269-d3d0-4f07-babd-a1dc72b5b083 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:51.173844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 859/1717] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:37:51.178425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:51.178425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:51.221140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:51.221760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.222043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.222318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.222974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:51.225052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:51.263747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 859/1718] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:37:51.264702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:51.277380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:51.349097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64469-2930-4cd3-9290-e43eaea863f5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:51.360954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:51.362004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.363462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.364570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] PATH_INFO: `/v3/projects/ccfc808142fe4128831f16730a17f762` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.366718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfc808142fe4128831f16730a17f762)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:51.370807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:51.440834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926f3e-04f4-46ad-954d-23a4a528e012 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:51.454171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:51.454846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.455072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.455395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.459816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:51.488432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfc808142fe4128831f16730a17f762', 'request_id': 'req-1cb9e835-30d5-4199-99f8-27ca337906e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:51.495802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfc808142fe4128831f16730a17f762', 'request_id': 'req-1cb9e835-30d5-4199-99f8-27ca337906e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:51.531830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfc808142fe4128831f16730a17f762', 'request_id': 'req-1cb9e835-30d5-4199-99f8-27ca337906e7'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:51.550924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:51.555621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:51.573731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 860/1719] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:51.574474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] The token cache is being invalidate because project ccfc808142fe4128831f16730a17f762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:51.574773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:51.575581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:51.576509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-1cb9e835-30d5-4199-99f8-27ca337906e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:51.579342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 860/1720] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:51 2022] DELETE /identity/v3/projects/ccfc808142fe4128831f16730a17f762 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:51.588331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634029c-d16e-4bb2-a000-85811cac4d1c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.588590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5d87-3413-4621-b624-57b0af7f93a0 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:51.588699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634029c-d16e-4bb2-a000-85811cac4d1c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.588873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634029c-d16e-4bb2-a000-85811cac4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.649230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a634029c-d16e-4bb2-a000-85811cac4d1c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:51.655526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a634029c-d16e-4bb2-a000-85811cac4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:51.656606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:51.723125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:51.724496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.725014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.725353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] PATH_INFO: `/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc/users/5a3d9b000a7d44ec9629110fe69e1e79/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.727748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e583bd775ae44fb2b8788a2c75d10bdc, user_id=5a3d9b000a7d44ec9629110fe69e1e79, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:51.733951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e1b7-9397-4699-bfb4-b5ce69490422 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:51.772224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 861/1721] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:51 2022] PUT /identity/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc/users/5a3d9b000a7d44ec9629110fe69e1e79/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:51.791022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.791362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.791752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.805726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:51.856370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] MFA Rules not processed for user `5a3d9b000a7d44ec9629110fe69e1e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:51.857984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:51.859177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 861/1722] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:51.867306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:51.867610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:51.871413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:51.910579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:51.928016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:52.063051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 862/1723] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:52.088090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 862/1724] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:52.094681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.129914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84ee3b-7932-48ed-a422-aad143188af6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.141732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.143804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:52.147109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.149041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.149391 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.149837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.150682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:37:52.151283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.154374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.181037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 863/1725] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:37:52.182164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.201039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804afb3-6cd4-41c2-aad5-f69a4574f1e8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.208311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.209022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.209446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.209787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.210587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.212771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.219411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbde0-abc3-4dc6-a74e-c7c9b7b24988 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.229503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.238795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.238795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.238795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.252281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.256043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.267088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 864/1726] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:52 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:52.272513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.283654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 863/1727] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:52.479258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c00fa8-8210-48e5-baa4-3fb1f3d4d6d8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.494424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.495243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.495995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.496433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.497316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.503025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.597233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 865/1728] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:52 2022] POST /identity/v3/users => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:52.599042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.611283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.612189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6056b5-71fc-4fbd-b90f-dfb6d39d19b6 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.634626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.635357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.635727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.636062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.636789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.638547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.655251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:52.656316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 864/1729] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:52.661024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.685387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c689b-75a7-4705-bb2d-81e4b36a1683 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.703380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.704641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.705005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.705546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.706421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.708903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.745857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 865/1730] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:52.747179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:52.763840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0da72e-6ca0-4ba1-ad77-0201f917b5df admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.768526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7c32-18de-4fc2-a7d1-629c9f4491c1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:52.777067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.777721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.777994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.778264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.780539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:52.781830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:52.786059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.786610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.787071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] PATH_INFO: `/v3/projects/284f6bfb270f47e4b47d94ff8dc89541/users/5f6b20e1a24c4343b0a598dc2321c8be/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.831123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] RBAC: Authorizing `identity:create_grant(project_id=284f6bfb270f47e4b47d94ff8dc89541, user_id=5f6b20e1a24c4343b0a598dc2321c8be, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.839794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abe86c-d40a-48cd-9d4e-34f503f5540f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.885620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 866/1731] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:52 2022] PUT /identity/v3/projects/284f6bfb270f47e4b47d94ff8dc89541/users/5f6b20e1a24c4343b0a598dc2321c8be/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:52.894588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d27ce-5d79-4e9e-a89d-c8a6c02c3d93 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:52.895384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d27ce-5d79-4e9e-a89d-c8a6c02c3d93 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:52.895904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d27ce-5d79-4e9e-a89d-c8a6c02c3d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:52.959403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:52.960185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4b7d27ce-5d79-4e9e-a89d-c8a6c02c3d93 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:52.962031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:52.962787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b7d27ce-5d79-4e9e-a89d-c8a6c02c3d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:52.990376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 866/1732] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:53.064512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:53.147430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 867/1733] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:53.165142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:53.166782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:53.344465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b8de8-6650-46a8-ae75-02c5cdbc6494 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:53.475690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:53.476454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:53.476800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:53.477183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:53.487737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:53.490094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a407225-50ed-4384-8fb1-62d5654b4383 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:53.507246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 867/1734] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:53.914947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:53.915429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:53.915639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:53.992973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985322-1986-4286-9cc5-1502d05e9c3b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:53.993440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985322-1986-4286-9cc5-1502d05e9c3b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:53.993520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985322-1986-4286-9cc5-1502d05e9c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.003332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] MFA Rules not processed for user `51def7315f294e99ba206f5db1ef282f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:54.007425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.049529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-3c985322-1986-4286-9cc5-1502d05e9c3b None None] MFA Rules not processed for user `d0aea5553e1043889571c50c3b01cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:54.050705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3c985322-1986-4286-9cc5-1502d05e9c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.104738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:54.212515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 868/1735] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:54.221409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 868/1736] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:54.226838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:54.227194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd0b4-8d01-453f-b50e-814abbdc834f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.227789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd0b4-8d01-453f-b50e-814abbdc834f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.228226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd0b4-8d01-453f-b50e-814abbdc834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.229106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.261216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-470bd0b4-8d01-453f-b50e-814abbdc834f None None] MFA Rules not processed for user `51def7315f294e99ba206f5db1ef282f`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:54.263881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-470bd0b4-8d01-453f-b50e-814abbdc834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.283499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 869/1737] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:54.284913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.285202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.285474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.355352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] MFA Rules not processed for user `f051f99404fc4e0593553ae95e1f90d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:54.356568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.389485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438fda5-33fb-4d4f-984e-b78f1e9c76c6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:54.398572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:54.399606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.399891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.400162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.415018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:54.416317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:54.437160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 869/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:54.437160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:54.437160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.457035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7619a-6d83-46ee-b317-b07c036d349d service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:54.464601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:54.465346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.465733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.466115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.476134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:54.477950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a773-eec5-4506-9a59-311c542da49c service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:54.496370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 870/1739] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:54.624934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 870/1740] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:54.626059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a50e9-f2ea-4a14-93bf-0c2c8b8e2d4d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.626350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a50e9-f2ea-4a14-93bf-0c2c8b8e2d4d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.626627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a50e9-f2ea-4a14-93bf-0c2c8b8e2d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.688588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4d7a50e9-f2ea-4a14-93bf-0c2c8b8e2d4d None None] MFA Rules not processed for user `f051f99404fc4e0593553ae95e1f90d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:54.689797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4d7a50e9-f2ea-4a14-93bf-0c2c8b8e2d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:54.713986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 871/1741] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:54.842244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:54.886428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c34ae-d55c-4e57-9e0d-57be8499b134 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:54.898906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:54.899527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:54.900131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:54.900413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:54.937312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:54.938906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:54.969338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 871/1742] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:55.021213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16084fee-01b9-440e-b1bf-5738bd87b2f0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.021680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16084fee-01b9-440e-b1bf-5738bd87b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.021798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16084fee-01b9-440e-b1bf-5738bd87b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.109520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-16084fee-01b9-440e-b1bf-5738bd87b2f0 None None] MFA Rules not processed for user `5f6b20e1a24c4343b0a598dc2321c8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:55.110769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-16084fee-01b9-440e-b1bf-5738bd87b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.227203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:55.278067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.279659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.305803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d25b10-f815-4d19-86ae-6cba69f483bb service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.336208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.336854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.337129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.337398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] PATH_INFO: `/v3/users/de7098d28d8c462486928038c8a6a340` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.344293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7098d28d8c462486928038c8a6a340)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.353470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.410336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 872/1743] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:55.410336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566613-9a02-42e1-9687-337f9a22bc65 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.410336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566613-9a02-42e1-9687-337f9a22bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.410336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566613-9a02-42e1-9687-337f9a22bc65 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.413961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 873/1744] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 17 08:37:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:55.414717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d566613-9a02-42e1-9687-337f9a22bc65 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.467676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d566613-9a02-42e1-9687-337f9a22bc65 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.486606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.487243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.487522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.487813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.488601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.491103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b202a-bfc1-4c1f-8653-55c76688db13 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.508638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7098d28d8c462486928038c8a6a340'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:55.530359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7098d28d8c462486928038c8a6a340'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:55.543102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7098d28d8c462486928038c8a6a340'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:55.545432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7098d28d8c462486928038c8a6a340'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:55.562143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7098d28d8c462486928038c8a6a340'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:55.571593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 874/1745] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:55.572951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.573240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.573517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.573879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:55.589371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 872/1746] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:55 2022] DELETE /identity/v3/users/de7098d28d8c462486928038c8a6a340 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:55.594161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.597926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.674343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:55.675617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.715093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287cfd2-072d-40ea-b4e3-a137113ba1a3 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.721960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.723965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.724359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.724799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.725552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.728073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f1eb-aa8d-4f4a-affa-86f2979cf5a4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.768904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 873/1747] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/users => generated 309 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:37:55.770643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.771243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.773313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.803104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 875/1748] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:55.804046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.814302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:55.815907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.830744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b6da-a6d1-49f2-852b-cbf656dfb99e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.833870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 874/1749] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:55.838371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.839111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.839394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.839770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.840430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.843670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.845862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:55.847923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.890182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 876/1750] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:55.891686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f49be-0cc1-4acd-b702-83e743c55f03 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.892532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.905851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.906835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.907571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.908051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.923228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e769c-ce59-42f1-a909-4f178b7be29b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.929627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.930300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.931247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.931931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.933810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.934125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.951991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 875/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:55.953397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:55.953844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.956146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adced4-8a7b-47f9-8e78-40f2d20c3770 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:55.967496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3238b-8ad0-41af-8cbb-3b0fcbc2c365 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:55.973080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:55.974370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.974649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.974922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] PATH_INFO: `/v3/projects/9149610f8c784df78a5260b2ab4929f7/users/839b8d2f32ec44f0bd9071640b3b6622/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.986739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 877/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:55.988100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf84c-4738-4c55-b8ac-e4975ee34ae6 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.988385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf84c-4738-4c55-b8ac-e4975ee34ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.988660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf84c-4738-4c55-b8ac-e4975ee34ae6 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.993745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9149610f8c784df78a5260b2ab4929f7, user_id=839b8d2f32ec44f0bd9071640b3b6622, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:55.994783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 878/1753] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 17 08:37:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:55.996094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:55.996384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:55.996665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:55.997025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:56.021508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 876/1754] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:55 2022] PUT /identity/v3/projects/9149610f8c784df78a5260b2ab4929f7/users/839b8d2f32ec44f0bd9071640b3b6622/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:56.023963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:56.034716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:56.036695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:56.154229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 879/1755] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:56.158889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a677-c8ba-4f9d-b801-6a63be24afee admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:56.165352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:56.167157 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:56.172005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:56.176091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:56.178270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:56.178823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:56.180735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:56.182566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:56.186134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727159-81f3-4278-90e7-e9e1613701b1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:56.195660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:56.196301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:56.198058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:56.198800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:56.212623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 877/1756] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:37:56.214272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:56.217541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:56.221371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:56.234969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6bcf-e9b6-4b24-8db8-f3170b1f4458 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:56.239723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 880/1757] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:37:56.243705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:56.244447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:56.244732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:56.245012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] PATH_INFO: `/v3/projects/9149610f8c784df78a5260b2ab4929f7/users/839b8d2f32ec44f0bd9071640b3b6622/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:56.246990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9149610f8c784df78a5260b2ab4929f7, user_id=839b8d2f32ec44f0bd9071640b3b6622, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:56.250464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:56.263600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 878/1758] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:37:56 2022] PUT /identity/v3/projects/9149610f8c784df78a5260b2ab4929f7/users/839b8d2f32ec44f0bd9071640b3b6622/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:56.692656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:56.697180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:56.761128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64deb8c-ef51-49fa-9adc-0394d120fb51 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:56.781935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:56.917389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:56.918900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:56.921507 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:56.922921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] PATH_INFO: `/v3/projects/4c428129acc542788ca27402166ba7c9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:56.925454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c428129acc542788ca27402166ba7c9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:56.929894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:57.128034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c428129acc542788ca27402166ba7c9', 'request_id': 'req-dc37782d-f311-471a-b0ba-b94bec2bfd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.150320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c428129acc542788ca27402166ba7c9', 'request_id': 'req-dc37782d-f311-471a-b0ba-b94bec2bfd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.178769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c428129acc542788ca27402166ba7c9', 'request_id': 'req-dc37782d-f311-471a-b0ba-b94bec2bfd6f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.216043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] The token cache is being invalidate because project 4c428129acc542788ca27402166ba7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:57.217138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.219684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.231144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:57.232924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 881/1759] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:56 2022] DELETE /identity/v3/projects/4c428129acc542788ca27402166ba7c9 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:57.234220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:57.267805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379338d-2f61-4037-8f5e-90f997849e96 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:57.384175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:57.402138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:57.403972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:57.531703 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:57.532787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:57.532937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37782d-f311-471a-b0ba-b94bec2bfd6f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:57.533352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:57.533782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] PATH_INFO: `/v3/users/a14e962cbc514772a953a77192ac7a67` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:57.535990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14e962cbc514772a953a77192ac7a67)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:57.538256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:57.540677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:57.543868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:57.544174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:57.544465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:57.548783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:57.679004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14e962cbc514772a953a77192ac7a67'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.696361 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:57.699334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:57.700953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c6d65-f201-42c7-9009-fed6b752af05 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:57.714251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 882/1760] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:57.716356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:57.716940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:57.726136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:57.727780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 883/1761] 10.222.0.15 () {54 vars in 961 bytes} [Wed Aug 17 08:37:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:37:57.733020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:57.735679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14e962cbc514772a953a77192ac7a67'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.737068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:57.766819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14e962cbc514772a953a77192ac7a67'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.767479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14e962cbc514772a953a77192ac7a67'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.787031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-82267507-41ca-4402-9d1b-519a13b735bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14e962cbc514772a953a77192ac7a67'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:57.811980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 879/1762] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:57 2022] DELETE /identity/v3/users/a14e962cbc514772a953a77192ac7a67 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:57.815646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbcfe-dc50-4441-9254-8d50ef8c2de1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:57.816131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbcfe-dc50-4441-9254-8d50ef8c2de1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:57.817004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbcfe-dc50-4441-9254-8d50ef8c2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:57.889011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ffebbcfe-dc50-4441-9254-8d50ef8c2de1 None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:57.893394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ffebbcfe-dc50-4441-9254-8d50ef8c2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:57.949758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b38f4-feb5-4d2a-b2e9-5d95a35ec975 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:58.024062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 880/1763] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Aug 17 08:37:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:58.025369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.025715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.025992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.053370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] MFA Rules not processed for user `f051f99404fc4e0593553ae95e1f90d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:58.055018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.109569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:58.110528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.110969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.112054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.115184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.140818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:58.141634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:58.144498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:58.179336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 881/1764] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:58.180649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:58.192280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 884/1765] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:58.196022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:58.198541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaadc54-ed30-4fbd-b3c8-444d78f525cb None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:58.201668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.212690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:58.213475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.213898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.214428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.227700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:58.229937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:58.271628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 882/1766] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:58.399840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2074-df3e-48c8-878e-d897ae869266 service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:58.414453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:58.416857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.417215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.417502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] PATH_INFO: `/v3/users/a6b74cd24d334491b104e38593c9e096` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.418974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b74cd24d334491b104e38593c9e096)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:58.420957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:58.487611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:58.532592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:58.534358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.547940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b74cd24d334491b104e38593c9e096'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.571307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26fbf-a57a-4e32-baed-25ff7f46e49c service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:58.590217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:58.590217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.601132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.601495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] PATH_INFO: `/v3/users/d8125639c56c44c5a749e027d917277d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.614825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8125639c56c44c5a749e027d917277d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:58.622725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b74cd24d334491b104e38593c9e096'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.625458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:58.625569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b74cd24d334491b104e38593c9e096'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.656352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b74cd24d334491b104e38593c9e096'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.657740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7815fe81-b183-451b-a12c-a87fe423646a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b74cd24d334491b104e38593c9e096'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.696929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 885/1767] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:58 2022] DELETE /identity/v3/users/a6b74cd24d334491b104e38593c9e096 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:58.703108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469b734-c7eb-4baf-b9b6-c2c1208b5ec8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.705119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469b734-c7eb-4baf-b9b6-c2c1208b5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.706522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469b734-c7eb-4baf-b9b6-c2c1208b5ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.751657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8125639c56c44c5a749e027d917277d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.784318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8125639c56c44c5a749e027d917277d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.803599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8125639c56c44c5a749e027d917277d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.804246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8125639c56c44c5a749e027d917277d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.820295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d2354c1-8e50-4342-a492-677137284437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8125639c56c44c5a749e027d917277d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:58.852837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c469b734-c7eb-4baf-b9b6-c2c1208b5ec8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:58.854357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c469b734-c7eb-4baf-b9b6-c2c1208b5ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.859894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 883/1768] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:37:58 2022] DELETE /identity/v3/users/d8125639c56c44c5a749e027d917277d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:37:58.863285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.864208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.864478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.928287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] MFA Rules not processed for user `d0aea5553e1043889571c50c3b01cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:58.932624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.940362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 886/1769] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:58.942741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:58.943323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:58.943323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:58.969434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:58.971007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:58.987074 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 887/1770] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:59.026466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:59.028025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:59.094800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 884/1771] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:59.115418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:59.117727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:59.226608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8819-6474-41e6-af8d-60b9f405bea4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:59.246201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:59.263883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:59.263883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:59.263883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:59.288651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:59.293513 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbad6c-4046-4446-939e-91d425463190 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:59.323529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 888/1772] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:59.324351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312e551-1edb-4db1-b451-9b2e7fb8cff9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:59.328419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:59.329045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:59.329324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:59.329600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:59.340035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:59.347159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:59.355844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:59.379403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 885/1773] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:37:59.436990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3cb0-cd77-47a8-8e4b-2614af62b7a0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:59.437415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3cb0-cd77-47a8-8e4b-2614af62b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:59.437978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3cb0-cd77-47a8-8e4b-2614af62b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:59.476762 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-caff3cb0-cd77-47a8-8e4b-2614af62b7a0 None None] MFA Rules not processed for user `839b8d2f32ec44f0bd9071640b3b6622`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:59.478315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-caff3cb0-cd77-47a8-8e4b-2614af62b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:59.526754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:59.539822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:37:59.541461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:37:59.568456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b2ec5-6114-4759-98dd-fdbaacd62bf9 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:37:59.580542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:37:59.583265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:59.583568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:59.583848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] PATH_INFO: `/v3/projects/3d91a20001b645d1b165eec373101907` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:59.585365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d91a20001b645d1b165eec373101907)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:37:59.592506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:37:59.643001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 889/1774] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:37:59.726446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d91a20001b645d1b165eec373101907', 'request_id': 'req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:59.747000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d91a20001b645d1b165eec373101907', 'request_id': 'req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:59.764726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d91a20001b645d1b165eec373101907', 'request_id': 'req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:59.791481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] The token cache is being invalidate because project 3d91a20001b645d1b165eec373101907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:37:59.792226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:59.793044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63aa86ec-ed90-4755-a1e2-4f1c5a716ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:37:59.799591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 886/1775] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:37:59 2022] DELETE /identity/v3/projects/3d91a20001b645d1b165eec373101907 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:37:59.802829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:37:59.803092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:37:59.803374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:37:59.875808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:37:59.878786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:00.049854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 890/1776] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:00.051976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.052271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.053818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.098108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:00.111572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:00.124774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 887/1777] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:00.126380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.141851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd95d9-0012-43c1-9a84-b449f5b9e1b5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.148803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.149480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.149707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.150031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.150672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:00.150983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.152748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.174037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 891/1778] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:00.175898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.200713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a1d4d-ed7f-4324-8357-b481b27e998d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.209707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.210523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.211488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.211913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.212643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.218088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.288224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 888/1779] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:00 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:00.292579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.311168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb0ae-6ebd-4f7e-b1b4-833cf080a536 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.483129 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.483778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.484060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.484332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.484959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.486899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.557744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 892/1780] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:00 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:00.561367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.601612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596da4b5-35d9-4645-8e6a-0a8e55fe9f0d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.621346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.622242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.622600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.622947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.623742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.630973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.646986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 889/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:00.651268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.670907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59ae2-6ac1-4dd8-9350-5e8da9d1b4e1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.679773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.680656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.680974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.681387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.682109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.684050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18e2fb-9756-49f9-927b-ffec7345463b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.718503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 893/1782] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:00.721817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:00.739801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f4b22-9df7-4da7-bad7-973cba066d40 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:00.746221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:00.748850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.748850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.749086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] PATH_INFO: `/v3/projects/c0af19f5c5a6467da9c8995606b63b8a/users/dca5ea63a0484daab2b66dc40bdff02e/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.774991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0af19f5c5a6467da9c8995606b63b8a, user_id=dca5ea63a0484daab2b66dc40bdff02e, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:00.779025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:00.811031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 890/1783] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:00 2022] PUT /identity/v3/projects/c0af19f5c5a6467da9c8995606b63b8a/users/dca5ea63a0484daab2b66dc40bdff02e/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:00.813028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:00.813318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:00.813599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:00.883876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] MFA Rules not processed for user `dca5ea63a0484daab2b66dc40bdff02e`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:00.885024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:00.955838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:01.026037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 894/1784] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:01.026522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.118773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50416c0-3ac6-43f1-9505-5c5f9fee78a5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.125244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.125861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.126147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.126422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.127184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.129579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.161879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:01.176119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 891/1785] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:01 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:01.181017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.192756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb4c6d-4533-4515-881f-5dbcc7071a82 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.264827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.266836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:01.298870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.299503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.299830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.300312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.301076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.303459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.350773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 895/1786] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:01 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:01.354567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.366863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2c40a-e768-4765-8f6d-475e3a4502a6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.372851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.373757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.374362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.374816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.375748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.377773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.406607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 896/1787] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:01.411194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809863c-5b5a-492e-9952-887a1183ca67 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.412949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.431926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.435743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.437460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.437877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] PATH_INFO: `/v3/projects/f802179aedf84b1ea5d177c426ca11b2` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.454720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f802179aedf84b1ea5d177c426ca11b2)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.456216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc672-894c-4711-9f15-102265891e7e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.461074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.477148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.494275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.494559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.494838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] PATH_INFO: `/v3/projects/523f57242db74d69b54a3e0375032d07/users/1b9de6ab9e634721a1c05a01d327fa9a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.534821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523f57242db74d69b54a3e0375032d07, user_id=1b9de6ab9e634721a1c05a01d327fa9a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.537228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.579238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 897/1788] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:01 2022] PUT /identity/v3/projects/523f57242db74d69b54a3e0375032d07/users/1b9de6ab9e634721a1c05a01d327fa9a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:01.580485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.585845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:01.603737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f802179aedf84b1ea5d177c426ca11b2', 'request_id': 'req-9cd8a135-1e75-44ea-9462-932d9cbb38c8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:01.617663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f802179aedf84b1ea5d177c426ca11b2', 'request_id': 'req-9cd8a135-1e75-44ea-9462-932d9cbb38c8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:01.632886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f802179aedf84b1ea5d177c426ca11b2', 'request_id': 'req-9cd8a135-1e75-44ea-9462-932d9cbb38c8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:01.651994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] The token cache is being invalidate because project f802179aedf84b1ea5d177c426ca11b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:01.652520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:01.653480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:01.655878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 892/1789] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:01 2022] DELETE /identity/v3/projects/f802179aedf84b1ea5d177c426ca11b2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:01.657361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.664181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:01.832207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a135-1e75-44ea-9462-932d9cbb38c8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.838353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.838973 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.839260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.839529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.840254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.842409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.881492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 893/1790] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:01.885151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:01.896539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a829cd5-bccf-4977-8300-856b025905a7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.897749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:01.934215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ae4-a0b5-40d8-9b6c-1aee1d6ed187 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:01.942775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.945178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.945682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.946058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] PATH_INFO: `/v3/users/acf6037112bc4bc5b9722d36f183598c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.949527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf6037112bc4bc5b9722d36f183598c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.951944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:01.952630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:01.952912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:01.953189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] PATH_INFO: `/v3/projects/2bbb3bf890154e42bdba7d5ed9d811f9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:01.961008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:01.972753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbb3bf890154e42bdba7d5ed9d811f9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:01.978547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:02.008616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:02.064263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf6037112bc4bc5b9722d36f183598c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.100369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf6037112bc4bc5b9722d36f183598c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.103755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:02.124623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf6037112bc4bc5b9722d36f183598c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.127244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf6037112bc4bc5b9722d36f183598c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.143428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf6037112bc4bc5b9722d36f183598c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.151985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 894/1791] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:01 2022] DELETE /identity/v3/users/acf6037112bc4bc5b9722d36f183598c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:02.152977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:02.154488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:02.187109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbb3bf890154e42bdba7d5ed9d811f9', 'request_id': 'req-7a78da9f-e568-4c30-8eb1-b16854165fb1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.198953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbb3bf890154e42bdba7d5ed9d811f9', 'request_id': 'req-7a78da9f-e568-4c30-8eb1-b16854165fb1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.219612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbb3bf890154e42bdba7d5ed9d811f9', 'request_id': 'req-7a78da9f-e568-4c30-8eb1-b16854165fb1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.236352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] The token cache is being invalidate because project 2bbb3bf890154e42bdba7d5ed9d811f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:02.236877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.238404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.244820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 898/1792] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:01 2022] DELETE /identity/v3/projects/2bbb3bf890154e42bdba7d5ed9d811f9 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:02.246068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:02.247770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:02.353490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a11e9-1faf-4255-a6bc-18c189a40140 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:02.368031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:02.369558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:02.371811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:02.372313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] PATH_INFO: `/v3/projects/523f57242db74d69b54a3e0375032d07/users/1b9de6ab9e634721a1c05a01d327fa9a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:02.377025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=523f57242db74d69b54a3e0375032d07, user_id=1b9de6ab9e634721a1c05a01d327fa9a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:02.379951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c35f13-c961-42e6-bfbe-ca33513b9a9f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:02.427975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78da9f-e568-4c30-8eb1-b16854165fb1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:02.442624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 895/1793] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:02 2022] PUT /identity/v3/projects/523f57242db74d69b54a3e0375032d07/users/1b9de6ab9e634721a1c05a01d327fa9a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:02.453814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:02.454143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:02.454440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:02.557698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] MFA Rules not processed for user `1b9de6ab9e634721a1c05a01d327fa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:02.560066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:02.579225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:02.580806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:02.581139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:02.582229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] PATH_INFO: `/v3/users/5a3d9b000a7d44ec9629110fe69e1e79` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:02.586865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3d9b000a7d44ec9629110fe69e1e79)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:02.592545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:02.736458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3d9b000a7d44ec9629110fe69e1e79'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.756064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:02.772158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3d9b000a7d44ec9629110fe69e1e79'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.774124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3d9b000a7d44ec9629110fe69e1e79'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.779316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 896/1794] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:02.794803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:02.817807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:02.819141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3d9b000a7d44ec9629110fe69e1e79'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.821515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3d9b000a7d44ec9629110fe69e1e79'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:02.884834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 899/1795] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:02 2022] DELETE /identity/v3/users/5a3d9b000a7d44ec9629110fe69e1e79 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:02.885924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:02.887392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:02.897989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:02.982641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd571570-a871-422f-82b7-583d27cfd3ee admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:02.991155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:02.993217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:02.993552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:02.994366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] PATH_INFO: `/v3/projects/62c037515cb640efaef415547b7f6457` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:02.996923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c037515cb640efaef415547b7f6457)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:03.000761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:03.009897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee182d-ee11-49d1-b5ad-58f413b1d423 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:03.126669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c037515cb640efaef415547b7f6457', 'request_id': 'req-a639c30e-97be-423d-a039-9a3b4d67b5c2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:03.144247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c037515cb640efaef415547b7f6457', 'request_id': 'req-a639c30e-97be-423d-a039-9a3b4d67b5c2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:03.173966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:03.175595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c037515cb640efaef415547b7f6457', 'request_id': 'req-a639c30e-97be-423d-a039-9a3b4d67b5c2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:03.178664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.181457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.181835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.189253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:03.204016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] The token cache is being invalidate because project 62c037515cb640efaef415547b7f6457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:03.204654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:03.206175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-a639c30e-97be-423d-a039-9a3b4d67b5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:03.208872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 900/1796] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:02 2022] DELETE /identity/v3/projects/62c037515cb640efaef415547b7f6457 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:03.211071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91905231-ac2b-4628-a215-7ca73e3bccb4 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.211525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91905231-ac2b-4628-a215-7ca73e3bccb4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.211938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91905231-ac2b-4628-a215-7ca73e3bccb4 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.214177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 901/1797] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:38:03.216684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0175-6903-432c-9d8b-6948beda98ff None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.216931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0175-6903-432c-9d8b-6948beda98ff None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.217202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f0175-6903-432c-9d8b-6948beda98ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.265761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-848f0175-6903-432c-9d8b-6948beda98ff None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:03.267104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-848f0175-6903-432c-9d8b-6948beda98ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:03.443605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:03.445283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf4659-27fa-4ee9-a6ce-e89ddb3137fd service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:03.468823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 902/1798] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:03.472134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.472423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.472734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.475109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 897/1799] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:03.479830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.480913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.480913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.498546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:03.530124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:03.531280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:03.540363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:03.547343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:03.559705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 898/1800] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:03.560779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:03.588966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3f25b-7cd9-402e-98fd-4816eec73c5e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:03.610088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:03.610987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.611065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.611316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.612338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:03.612651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:03.614819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:03.655619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 899/1801] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:03.655619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:03.681707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac60-c3ed-462a-8ab7-dfdcbaa5cab2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:03.682990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 903/1802] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:38:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:03.695021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:03.697510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:03.698068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:03.700531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:03.701426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:03.706741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:03.778847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 900/1803] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:03 2022] POST /identity/v3/projects => generated 409 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:03.783517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:03.798407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d107ca-9bec-45a8-aeff-f37c57b86021 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:03.828806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:03.835905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.001838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:04.012650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.014964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.015329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.017171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.018343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.025214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.085378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548f58-15f1-400d-a71c-e9568b408e2e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.094094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 904/1804] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:03 2022] POST /identity/v3/users => generated 305 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:04.100210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.134349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc242-1100-41e1-9425-3b390954f15d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.135747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.138202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.139382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.140901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.151755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.156652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.156937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.158952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.161181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.162834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.196478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.204293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.224435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 905/1805] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:04.229170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.251574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 901/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:04.282949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80359511-0ac8-4d32-9a17-89a4259fb92e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.291191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.292199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.293254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.293556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.294387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.297183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.319596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 906/1807] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:04.321860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.336615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3d2e-fcaa-4136-afaa-f5ce12475ab2 service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.349994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.350928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.351350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.354491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] PATH_INFO: `/v3/projects/578adae40fc14f07b92bbf8fe9d38c72/users/92fd19ef17b1495fbb65be897d65c54d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.391528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.393375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.406554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] RBAC: Authorizing `identity:create_grant(project_id=578adae40fc14f07b92bbf8fe9d38c72, user_id=92fd19ef17b1495fbb65be897d65c54d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.415624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939db2-34a2-4e85-9167-3a345b8e036e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.424956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfb073-260b-4b74-aa9a-272337de084f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.435844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.436860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.437278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.437874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] PATH_INFO: `/v3/users/dca5ea63a0484daab2b66dc40bdff02e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.439969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca5ea63a0484daab2b66dc40bdff02e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.444677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.454297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 902/1808] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:04 2022] PUT /identity/v3/projects/578adae40fc14f07b92bbf8fe9d38c72/users/92fd19ef17b1495fbb65be897d65c54d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:04.467739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.468402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.468988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.547206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca5ea63a0484daab2b66dc40bdff02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:04.560575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:04.562525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca5ea63a0484daab2b66dc40bdff02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:04.564534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca5ea63a0484daab2b66dc40bdff02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:04.572149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] MFA Rules not processed for user `92fd19ef17b1495fbb65be897d65c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:04.573802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.579909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca5ea63a0484daab2b66dc40bdff02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:04.583653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e3caf448-b41f-4d78-aa69-e57f5a9b8d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca5ea63a0484daab2b66dc40bdff02e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:04.602795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 907/1809] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:04 2022] DELETE /identity/v3/users/dca5ea63a0484daab2b66dc40bdff02e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:04.607688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.608177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.608615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.651111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:04.657612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.695383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 903/1810] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:04.697848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.700855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.751908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 908/1811] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:04.787950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65515ff0-fd33-42da-b8d2-19f3d80713d4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.792834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.793397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.793679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.793972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.794594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.796662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:04.817920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.819600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:04.837771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 904/1812] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:04 2022] POST /identity/v3/projects => generated 407 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:04.841883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:04.878930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:04.925180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95e6b-5ab0-456a-a0c0-8251475e0388 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.974115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdbcc-7e03-4726-9c85-5a1ef1e3f019 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:04.983382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:04.984194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:04.984661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:04.985444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:04.986800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:04.990040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.049510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 905/1813] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:04 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:05.052344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.055110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.073320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d2543-94f9-4d72-859f-c06363573bb5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.077954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.078754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.079168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.079765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.085286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.086279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.086737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.087109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] PATH_INFO: `/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.088542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e583bd775ae44fb2b8788a2c75d10bdc)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.090729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.098967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.101237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.112031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 909/1814] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:05.113063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.124309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63683c43-48a6-41e6-ac67-8404731297cd service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.131829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.132718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.133182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.133730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.134625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.136544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.149359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 910/1815] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:05.153674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.157811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e583bd775ae44fb2b8788a2c75d10bdc', 'request_id': 'req-d98fc735-46c9-4c66-829e-6b89c02f8923'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:05.165085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e583bd775ae44fb2b8788a2c75d10bdc', 'request_id': 'req-d98fc735-46c9-4c66-829e-6b89c02f8923'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:05.166144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752c4a-9548-4d15-bdc3-d4427eedeeac admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.179675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e583bd775ae44fb2b8788a2c75d10bdc', 'request_id': 'req-d98fc735-46c9-4c66-829e-6b89c02f8923'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:05.198630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] The token cache is being invalidate because project e583bd775ae44fb2b8788a2c75d10bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:05.199074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:05.199900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d98fc735-46c9-4c66-829e-6b89c02f8923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:05.205511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 906/1816] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:05 2022] DELETE /identity/v3/projects/e583bd775ae44fb2b8788a2c75d10bdc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:05.208380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:05.212290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03b0c4-235e-4e79-bfd0-098d39cf4dac None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.213061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03b0c4-235e-4e79-bfd0-098d39cf4dac None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.213562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03b0c4-235e-4e79-bfd0-098d39cf4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.255041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6a03b0c4-235e-4e79-bfd0-098d39cf4dac None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:05.258679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6a03b0c4-235e-4e79-bfd0-098d39cf4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.267039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.267771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.268058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.268340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] PATH_INFO: `/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee/users/e91106b3bb6e4d369760c3bf60bd8222/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.285923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 907/1817] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:05.292146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.293036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.293377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.305088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03f0213a66d4cd3bee511ad7f4ae2ee, user_id=e91106b3bb6e4d369760c3bf60bd8222, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.308616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.329119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:05.331824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 911/1818] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:05 2022] PUT /identity/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee/users/e91106b3bb6e4d369760c3bf60bd8222/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:05.333477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.336920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.339574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.461557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 908/1819] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:05.462899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.475832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771475f7-c513-447a-ab81-7ffd7164de93 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.478804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee3ff-71f2-4569-8b27-80db3f07392c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.482776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.484030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.484435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.484803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.485818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.487710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.492226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.493017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.493315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.493588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.494262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:05.494834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.499652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.508319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 912/1820] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:05.509419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.518449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 909/1821] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:05.519281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.530130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cef23c-ab0f-4a92-b123-be2dc1c3ab6a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.532992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6044-86c0-4250-ba3a-5fb81ee7a983 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.538825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.539958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.539958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.540290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] PATH_INFO: `/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee/users/e91106b3bb6e4d369760c3bf60bd8222/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.543882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03f0213a66d4cd3bee511ad7f4ae2ee, user_id=e91106b3bb6e4d369760c3bf60bd8222, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.546891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c431148-fd81-469a-9099-966d7bbaa34f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.550082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.550644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.550979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.551804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.552444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.554375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.588839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:05.600405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 913/1822] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:05 2022] PUT /identity/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee/users/e91106b3bb6e4d369760c3bf60bd8222/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:05.606022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5761bd-ea1c-457e-b962-92114fac1ebf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.606022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5761bd-ea1c-457e-b962-92114fac1ebf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.606022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5761bd-ea1c-457e-b962-92114fac1ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.625190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 910/1823] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:05.626092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.683790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1a5761bd-ea1c-457e-b962-92114fac1ebf None None] MFA Rules not processed for user `e91106b3bb6e4d369760c3bf60bd8222`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:05.685244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1a5761bd-ea1c-457e-b962-92114fac1ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.733698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1984-ca8c-4608-b1ae-b2429e985a70 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.740525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.741156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.741584 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.741865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.742505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.744531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86cb6d-2362-45d4-b653-0e344ffb4234 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.807673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 911/1824] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:05.807673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb4f3-95d0-4a07-a870-7cbb9e9ccbb5 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.807673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb4f3-95d0-4a07-a870-7cbb9e9ccbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.807673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb4f3-95d0-4a07-a870-7cbb9e9ccbb5 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.812932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 912/1825] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:38:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:38:05.813775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb4f3-95d0-4a07-a870-7cbb9e9ccbb5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.846313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb4f3-95d0-4a07-a870-7cbb9e9ccbb5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:05.853655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 914/1826] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:05.856290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.856754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.857199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.876107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:05.877014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:05.877980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:05.878480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:05.879840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:05.884850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:05.910323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] MFA Rules not processed for user `2c853b65b78d44a8a5656c1b84b4bff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:05.912467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.919358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 913/1827] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:05.921144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:05.923630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:05.943215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:06.076165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 915/1828] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:06.079099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.104071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b0c2-fed1-4c88-96a8-9f7ac4e6a17f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.124080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.124742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.125032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.125294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.126333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d411ac-3609-4659-8cd6-be5bb79a8f7b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.136491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.137141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.137424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.137700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.141060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.142724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.154646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.159064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.179222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 916/1829] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:06.181185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.185506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 914/1830] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:05 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:06.187111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.189226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.193791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.211955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a3b8-b01b-4538-b434-a72344b1fae5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.220180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd17f5-1aa4-459a-a7d7-cb129cebd3c3 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.223748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.224322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.224604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.224891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] PATH_INFO: `/v3/users/5f6b20e1a24c4343b0a598dc2321c8be` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.226318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6b20e1a24c4343b0a598dc2321c8be)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.228293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.234084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.235478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.235798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.236057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] PATH_INFO: `/v3/projects/c0af19f5c5a6467da9c8995606b63b8a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.238120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0af19f5c5a6467da9c8995606b63b8a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.240188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.322057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6b20e1a24c4343b0a598dc2321c8be'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.342481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0af19f5c5a6467da9c8995606b63b8a', 'request_id': 'req-53b6e458-96fb-4994-944a-679039f3f3b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.342909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6b20e1a24c4343b0a598dc2321c8be'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.343896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6b20e1a24c4343b0a598dc2321c8be'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.350828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0af19f5c5a6467da9c8995606b63b8a', 'request_id': 'req-53b6e458-96fb-4994-944a-679039f3f3b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.358732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6b20e1a24c4343b0a598dc2321c8be'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.359896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6b20e1a24c4343b0a598dc2321c8be'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.365409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0af19f5c5a6467da9c8995606b63b8a', 'request_id': 'req-53b6e458-96fb-4994-944a-679039f3f3b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.368609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:06.381780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 917/1831] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:06 2022] DELETE /identity/v3/users/5f6b20e1a24c4343b0a598dc2321c8be => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:06.383671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.386435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] The token cache is being invalidate because project c0af19f5c5a6467da9c8995606b63b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:06.387057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.387307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.388311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.391039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 915/1832] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:06 2022] DELETE /identity/v3/projects/c0af19f5c5a6467da9c8995606b63b8a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:06.392032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.395193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.495076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b74185-14e6-4816-a6af-f39113f38711 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.500178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.500858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.501139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.501551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] PATH_INFO: `/v3/projects/d28943895e654a6fa66e8efb981ad042/users/1883a8af324d4edcaa4b80f27ef94a85/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.516669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e458-96fb-4994-944a-679039f3f3b5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.518698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28943895e654a6fa66e8efb981ad042, user_id=1883a8af324d4edcaa4b80f27ef94a85, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.521468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.538134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:06.545292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 918/1833] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:06 2022] PUT /identity/v3/projects/d28943895e654a6fa66e8efb981ad042/users/1883a8af324d4edcaa4b80f27ef94a85/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:06.556033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.558779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.625603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.626317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.626624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.626899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.630288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.642033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb261b9-7384-4989-aa6a-8c2f8e4aad44 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.647422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.649730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.650576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.651456 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.651783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.652112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] PATH_INFO: `/v3/users/1b9de6ab9e634721a1c05a01d327fa9a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.653755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9de6ab9e634721a1c05a01d327fa9a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.656381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.663674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 916/1834] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:06.664679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.666202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.744567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97ad7e-56eb-44db-83a7-ce33599f61de service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:06.750294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9de6ab9e634721a1c05a01d327fa9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.762713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9de6ab9e634721a1c05a01d327fa9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.763405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9de6ab9e634721a1c05a01d327fa9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.772221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9de6ab9e634721a1c05a01d327fa9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.772856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e0e1cfdc-4cb5-479d-a4ac-753e8b7d9d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9de6ab9e634721a1c05a01d327fa9a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:06.790833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 919/1835] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:06 2022] DELETE /identity/v3/users/1b9de6ab9e634721a1c05a01d327fa9a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:06.790833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.790833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.790833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.792090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:06.801578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:06.802307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.802650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.802986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:06.805269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.822094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] MFA Rules not processed for user `1883a8af324d4edcaa4b80f27ef94a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:06.823833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.938102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 920/1836] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:06.939111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:06.940576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:06.951851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:06.953541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:06.955114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad15156-b1d3-41c8-b9df-737f8c585249 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:06.969632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 917/1837] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:06.971481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:06.971802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:06.972184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.060763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:07.062156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:07.077569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560276bb-e504-4091-82b3-7f0d10b1d452 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:07.093859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:07.094511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:07.094788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:07.095052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] PATH_INFO: `/v3/projects/284f6bfb270f47e4b47d94ff8dc89541` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.096298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=284f6bfb270f47e4b47d94ff8dc89541)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:07.098785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:07.235422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284f6bfb270f47e4b47d94ff8dc89541', 'request_id': 'req-f346cadf-997f-4c53-a894-eca2b23feafd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.257261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284f6bfb270f47e4b47d94ff8dc89541', 'request_id': 'req-f346cadf-997f-4c53-a894-eca2b23feafd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.259459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 918/1838] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:07.261599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:07.274684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:07.279340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284f6bfb270f47e4b47d94ff8dc89541', 'request_id': 'req-f346cadf-997f-4c53-a894-eca2b23feafd'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.319360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] The token cache is being invalidate because project 284f6bfb270f47e4b47d94ff8dc89541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:07.319678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.327021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979439c-0046-4bf7-ba9e-ec652086728d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:07.328550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f346cadf-997f-4c53-a894-eca2b23feafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.332616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 921/1839] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:06 2022] DELETE /identity/v3/projects/284f6bfb270f47e4b47d94ff8dc89541 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:07.346205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:07.346365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:07.351951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.394514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:07.394514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:07.447097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:07.447756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:07.448034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:07.448370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.449150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:07.455002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:07.499312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:07.556671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 919/1840] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:07 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:07.566245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 922/1841] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Aug 17 08:38:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:07.567213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:07.581011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:07.584401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:07.588915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:07.653557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3047749-b5fa-4fc1-a39c-a505deb1b7e5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:07.812133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:07.819625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6ded-9db3-4942-b16e-75aff2c4d9cc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:07.825789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:07.826661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:07.827114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:07.827395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] PATH_INFO: `/v3/projects/523f57242db74d69b54a3e0375032d07` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.829463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523f57242db74d69b54a3e0375032d07)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:07.830991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:07.838555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:07.839206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:07.839486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:07.839918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] PATH_INFO: `/v3/users/839b8d2f32ec44f0bd9071640b3b6622` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:07.841099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839b8d2f32ec44f0bd9071640b3b6622)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:07.843585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:07.929018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523f57242db74d69b54a3e0375032d07', 'request_id': 'req-b845038c-f397-45f5-9dc5-302c6d290285'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.943645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523f57242db74d69b54a3e0375032d07', 'request_id': 'req-b845038c-f397-45f5-9dc5-302c6d290285'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.950162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839b8d2f32ec44f0bd9071640b3b6622'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.966107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523f57242db74d69b54a3e0375032d07', 'request_id': 'req-b845038c-f397-45f5-9dc5-302c6d290285'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.997820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839b8d2f32ec44f0bd9071640b3b6622'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:07.998932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839b8d2f32ec44f0bd9071640b3b6622'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.008361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] The token cache is being invalidate because project 523f57242db74d69b54a3e0375032d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:08.008361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.009067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.011338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 920/1842] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:07 2022] DELETE /identity/v3/projects/523f57242db74d69b54a3e0375032d07 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:08.012373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.013737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.026538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839b8d2f32ec44f0bd9071640b3b6622'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.027842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839b8d2f32ec44f0bd9071640b3b6622'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.045714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 923/1843] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:07 2022] DELETE /identity/v3/users/839b8d2f32ec44f0bd9071640b3b6622 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:08.050377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.052726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.119784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845038c-f397-45f5-9dc5-302c6d290285 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.164099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:08.208409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443b7a-9fad-49a5-8cfb-49615e52af79 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.211662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.212500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.213008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.213280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.213937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.216083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.219274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.220039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.220321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.220592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.223290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.260545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 921/1844] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:08 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:08.261401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.266047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.289294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:08.304683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.321661 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.335229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 924/1845] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:38:08.336332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.339761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.408320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c118cd-802d-4de9-96a9-c7e8ee4ee01d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.413501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.414333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.414679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.415063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.417885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.444621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.446708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b04c6-dc83-49bc-9986-419afdbffd27 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.455329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46044f2e-663b-4f97-ad0d-0a384d7d1650 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.456735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 922/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:08.458403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.458691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.458963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.479730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.481200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.481450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:08.481792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.482406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.482920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.498427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 923/1847] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:08.499440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.505877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.507505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.510585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62eb67-8fb7-457c-8d2d-647441efaad0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.515108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.515775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.516061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.516337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.525041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.526493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.529067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 925/1848] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:08.529905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.556396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 924/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:08.558793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.560649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.569306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0033-09d1-4c88-9791-9affa8678305 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.579023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.579164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4844bf7-e6f3-4e48-b834-f72857254326 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.579532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.579923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.580200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.580854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.585562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb037d-1285-4ce1-a379-69632ee1349e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.585723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.586377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.586665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.586941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] PATH_INFO: `/v3/projects/9149610f8c784df78a5260b2ab4929f7` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.588244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9149610f8c784df78a5260b2ab4929f7)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:08.600233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:08.647683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 926/1850] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:08.665794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357feeb-29eb-40d6-ac61-ab9b5da0ce19 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.668131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357feeb-29eb-40d6-ac61-ab9b5da0ce19 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.669345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357feeb-29eb-40d6-ac61-ab9b5da0ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:08.680675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9149610f8c784df78a5260b2ab4929f7', 'request_id': 'req-2bd9cd3b-7108-4cec-9dd5-a282827da79f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.687521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9149610f8c784df78a5260b2ab4929f7', 'request_id': 'req-2bd9cd3b-7108-4cec-9dd5-a282827da79f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.699273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9149610f8c784df78a5260b2ab4929f7', 'request_id': 'req-2bd9cd3b-7108-4cec-9dd5-a282827da79f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.718790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] The token cache is being invalidate because project 9149610f8c784df78a5260b2ab4929f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:08.719334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.720281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:08.729891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 925/1851] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:08 2022] DELETE /identity/v3/projects/9149610f8c784df78a5260b2ab4929f7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:08.731402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:08.734100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.789161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0357feeb-29eb-40d6-ac61-ab9b5da0ce19 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:08.792840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0357feeb-29eb-40d6-ac61-ab9b5da0ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:08.854776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:08.960015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cd3b-7108-4cec-9dd5-a282827da79f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:08.976552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:08.978758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:08.979047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:08.979324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] PATH_INFO: `/v3/projects/d91eb13ebcae472c96c08085fe4826c6/users/50cb0265ccd7440d83e0bc1a8cbfe2bd/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.018571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 927/1852] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:09.018918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.019422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.020340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.044511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91eb13ebcae472c96c08085fe4826c6, user_id=50cb0265ccd7440d83e0bc1a8cbfe2bd, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.047213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.081167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:09.085384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:09.104490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 926/1853] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:08 2022] PUT /identity/v3/projects/d91eb13ebcae472c96c08085fe4826c6/users/50cb0265ccd7440d83e0bc1a8cbfe2bd/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:09.105359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.341743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 928/1854] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:09.342728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.387736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fa7f1-4b75-4866-a3eb-5a9e5689c027 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.393870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25921c-2b00-4d52-9522-d0e3cffc9bd6 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.409553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.412146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.412448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.412729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.413406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.416235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb591c5-42b3-4c7b-9a13-fb2efb373677 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.419860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.421243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.421695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.422139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.423996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:09.424463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.429208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.462132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 929/1855] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:09.464444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.464732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.465010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.473449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 927/1856] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:09.474872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.539685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610028f-0cd1-4f48-92a6-aa6825d28367 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.564357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.566766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.567151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.567520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] PATH_INFO: `/v3/projects/d91eb13ebcae472c96c08085fe4826c6/users/50cb0265ccd7440d83e0bc1a8cbfe2bd/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.571767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:09.574394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:09.579816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91eb13ebcae472c96c08085fe4826c6, user_id=50cb0265ccd7440d83e0bc1a8cbfe2bd, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.588528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.610148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 930/1857] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:09.612160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.636487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:09.651587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 928/1858] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:09 2022] PUT /identity/v3/projects/d91eb13ebcae472c96c08085fe4826c6/users/50cb0265ccd7440d83e0bc1a8cbfe2bd/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:09.651587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.651883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70309be4-bff5-471a-80b3-cc153ddee071 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.777235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.777977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.778301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.778621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.779293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.793046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f9a04-59b4-4b1c-a4dc-b97981260e30 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.815600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e05f0-3c7a-4073-9398-3ca54bb961e3 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.824674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.825758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.826069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.826312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.826974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:09.827368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.828952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.841690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 931/1859] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:09.843353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 929/1860] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:09.844095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.844569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.844797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.845794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.860773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca9304-3a27-4c9d-ae81-48f2b31257f9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.886573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] MFA Rules not processed for user `50cb0265ccd7440d83e0bc1a8cbfe2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:09.888498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:09.889639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:09.943125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.944114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.944398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.944949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.945694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.948907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:09.968526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 932/1861] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:09.969194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.983031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada10f-e989-488b-8207-3ed0ee7d1d35 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:09.983825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 930/1862] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:09.985288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:09.988064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:09.993966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:09.994592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:09.994868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:09.995136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:09.995791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:09.997714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.030097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 933/1863] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:09 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:10.030753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.059782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baad7a-90ee-4e0c-838b-4ec181a3e3fd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.104639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:10.117703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247630d-be68-4e5e-9f6b-b53cb5b4c7a2 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.120157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.120750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.121528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.121856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.124425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.125041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.125322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.125599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.126249 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.127896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.139515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 934/1864] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:10.143126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.153636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f6fa9-8018-4f9c-83e6-d2edcb9a3f92 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.159120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.159768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.160094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.160353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.161057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.162992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.189086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 935/1865] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:10.190194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.198048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.199863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.200691 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d35acb-09cb-49cf-ab60-690a86cd2d6b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.205439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.206054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.206498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.206596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.207262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.209193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.228018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 931/1866] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:10.228018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.232414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 936/1867] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:10.237493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.237633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9569-539b-4a46-b4a1-b83a203fc513 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.248599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.249380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.249663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.249935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.250593 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.252413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.257918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1725b-91bd-40fb-9856-acec192c0215 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.272105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 932/1868] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:10.281403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.281734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.281734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.288094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.288538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] PATH_INFO: `/v3/projects/859f32f91acf425eb662d007fca60b77/users/f1c899c9bd204a55946680793a13d7ff/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.289294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839304-8970-4df2-982c-77257ef8d991 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.295808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.296749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.297220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.297682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.298521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.300422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.308793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:10.312165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859f32f91acf425eb662d007fca60b77, user_id=f1c899c9bd204a55946680793a13d7ff, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.315632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdb79e-75d2-40bf-8741-d0844551ad95 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.316197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 933/1869] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:10.322275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.344770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ba985-68d9-40f2-8892-cfdab698bb43 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.358393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 937/1870] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:10 2022] PUT /identity/v3/projects/859f32f91acf425eb662d007fca60b77/users/f1c899c9bd204a55946680793a13d7ff/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:10.371860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.372266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.372542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.408633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] MFA Rules not processed for user `f1c899c9bd204a55946680793a13d7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:10.411998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:10.436288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.436984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.437267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.437544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] PATH_INFO: `/v3/projects/e162c055f2e54c80b2183e3b89d8b0b1/users/d2bfc3a4cdd340a9bd60ac5c8b011ef1/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.470310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e162c055f2e54c80b2183e3b89d8b0b1, user_id=d2bfc3a4cdd340a9bd60ac5c8b011ef1, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.474069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b65065-7e5d-4682-9902-401266984b97 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.500077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 934/1871] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:10 2022] PUT /identity/v3/projects/e162c055f2e54c80b2183e3b89d8b0b1/users/d2bfc3a4cdd340a9bd60ac5c8b011ef1/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:10.506624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.507003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.507344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.521485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 938/1872] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:10.522405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.536768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885f789-2d9c-434f-81b2-b245bf39e8b7 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.543009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] MFA Rules not processed for user `d2bfc3a4cdd340a9bd60ac5c8b011ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:10.544389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:10.604274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.604969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.605245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.605576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.606231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.609039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.626567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 935/1873] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:10.632094 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.645203 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1a48b-c905-4771-a34e-083d3d56a41a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.651811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 939/1874] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:10.654154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.686952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:10.779795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.781058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.782671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.783130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.783841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.804717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.833197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:10.857577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 936/1875] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:10.859002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:10.865788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e15dd-ea98-4f88-b405-b872b8a1e0b1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:10.989469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:10.990469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:10.991103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:10.991645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:10.993545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:10.996246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:10.999139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968c918-d0e0-4693-babe-c6f35071ed9e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.011603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.011750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.013020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.014077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.014833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.018854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.040252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 940/1876] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/users => generated 299 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:11.041284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.052604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb86ea-3ca5-4bbe-bdd6-95a33718e994 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.059963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.061188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.061493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.062139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.062375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.064156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.072377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 937/1877] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:10 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:11.073664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.077898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 941/1878] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:11.085694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.091677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254eb3-c37f-49a6-8187-775a65314ad8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.101913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.103660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.104132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.104568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.105831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.108083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8ba-3237-45b0-b0fc-7123f8cdbe6c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.108671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.113562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.114236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.114521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.114838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] PATH_INFO: `/v3/projects/2b530ba6dada4896903a961db4f4fd2a/users/82d12ecf8d8d487e87da6f93854c5877/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.129472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 938/1879] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:11.130559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.139879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b530ba6dada4896903a961db4f4fd2a, user_id=82d12ecf8d8d487e87da6f93854c5877, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.142991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176e91e-0517-4c77-88bd-41aa26d749fa admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.143330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237806-73fe-472c-987a-229b72796d31 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.154281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.155241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.155386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.155583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] PATH_INFO: `/v3/projects/78a82b2b5e844c27acd04b8924b60a35/users/69c6adf52b3d4a1788d90ad7b23636a8/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.163480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 942/1880] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:11 2022] PUT /identity/v3/projects/2b530ba6dada4896903a961db4f4fd2a/users/82d12ecf8d8d487e87da6f93854c5877/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:11.164887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abd8-13c9-450f-b316-abf4ca817ae3 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.165322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abd8-13c9-450f-b316-abf4ca817ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.165725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051abd8-13c9-450f-b316-abf4ca817ae3 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.171592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 943/1881] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:38:11.171592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051abd8-13c9-450f-b316-abf4ca817ae3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.186877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a82b2b5e844c27acd04b8924b60a35, user_id=69c6adf52b3d4a1788d90ad7b23636a8, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.190106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376a34a-59a8-405d-9c35-c46dfb70d8aa admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.209351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 939/1882] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:11 2022] PUT /identity/v3/projects/78a82b2b5e844c27acd04b8924b60a35/users/69c6adf52b3d4a1788d90ad7b23636a8/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:11.211120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.211409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.212153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.254869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:11.257952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:11.302403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051abd8-13c9-450f-b316-abf4ca817ae3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.345495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:11.425520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.426145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.426521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.426891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.427665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.429397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.459108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 944/1883] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:11.461409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.470877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 940/1884] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:11.471757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.484998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b1aa-6bab-463b-bad2-f5226903b06f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.485866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890ec-5a53-4d00-9e25-0cb0bfc793a9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.493074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.493858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.494384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.494670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] PATH_INFO: `/v3/projects/2b530ba6dada4896903a961db4f4fd2a/users/82d12ecf8d8d487e87da6f93854c5877/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.497436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.498208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.498750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b530ba6dada4896903a961db4f4fd2a, user_id=82d12ecf8d8d487e87da6f93854c5877, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.498934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.499301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.501935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b701a-3d55-48e3-bd52-c15fb7949c76 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.505695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.505695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.530338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 941/1885] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:11 2022] PUT /identity/v3/projects/2b530ba6dada4896903a961db4f4fd2a/users/82d12ecf8d8d487e87da6f93854c5877/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:11.531435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 945/1886] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:11.532040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742513e3-b462-47d6-a4e4-a9726460554c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.532331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742513e3-b462-47d6-a4e4-a9726460554c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.532642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742513e3-b462-47d6-a4e4-a9726460554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.535782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.546884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb82caa-253c-4b4b-adf6-b733b8ade322 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.640346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.643570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.644694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.646244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] PATH_INFO: `/v3/projects/78a82b2b5e844c27acd04b8924b60a35/users/69c6adf52b3d4a1788d90ad7b23636a8/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.657806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a82b2b5e844c27acd04b8924b60a35, user_id=69c6adf52b3d4a1788d90ad7b23636a8, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.661269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.682809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-742513e3-b462-47d6-a4e4-a9726460554c None None] MFA Rules not processed for user `82d12ecf8d8d487e87da6f93854c5877`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:11.692479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 946/1887] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:11 2022] PUT /identity/v3/projects/78a82b2b5e844c27acd04b8924b60a35/users/69c6adf52b3d4a1788d90ad7b23636a8/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:11.692623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-742513e3-b462-47d6-a4e4-a9726460554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:11.693352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.697671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:11.740943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:11.846284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 942/1888] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:11.847782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.848062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.848394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.882488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415421d-339c-4d08-adcf-cb57e514fdf9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:11.888257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] MFA Rules not processed for user `69c6adf52b3d4a1788d90ad7b23636a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:11.888987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:11.889625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:11.891779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:11.892147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:11.892531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:11.908612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:11.911065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:11.928930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 947/1889] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:11.930265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:11.987958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:12.021448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 943/1890] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:12.037687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:12.039602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:12.053475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be86a0-1fdb-4784-8e73-4cbaf4a20da4 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.053938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff159-696a-4ddc-b0db-8a47bdc41d03 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.057621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.058262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.058587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.058765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.061278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.062750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.063143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.063515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.072717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.073748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0de1f9-a5f8-413a-84f2-f300564cbb93 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.075028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.077087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.091732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 944/1891] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:12.092012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 948/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:12.169205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:12.255772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85fe81-39d5-429f-8d93-20d5a3d8bf6b service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.260686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.261427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.261772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.262127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] PATH_INFO: `/v3/users/f1c899c9bd204a55946680793a13d7ff` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.263349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c899c9bd204a55946680793a13d7ff)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.265370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.393611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c899c9bd204a55946680793a13d7ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.436150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c899c9bd204a55946680793a13d7ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.450666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c899c9bd204a55946680793a13d7ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.479031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c899c9bd204a55946680793a13d7ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.479876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c899c9bd204a55946680793a13d7ff'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.516457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 949/1893] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:12 2022] DELETE /identity/v3/users/f1c899c9bd204a55946680793a13d7ff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:12.525632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.526128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.526432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.565729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:12.568230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:12.707941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 945/1894] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:12.713262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:12.714901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:12.754978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:12.756732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:12.771926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c55177-71dd-48b2-b153-c4cdf06936f7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.787768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.788467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.788749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.789022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] PATH_INFO: `/v3/users/1883a8af324d4edcaa4b80f27ef94a85` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.790913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1883a8af324d4edcaa4b80f27ef94a85)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.793522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.836103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:12.852908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da7a3-afe3-40e4-9081-45ab5e0f30b7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.863562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.864239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.864512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.864928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.865602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:12.887413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.888982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.901692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1883a8af324d4edcaa4b80f27ef94a85'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.906742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 950/1895] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:12.907763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:12.909775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:12.920589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1883a8af324d4edcaa4b80f27ef94a85'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.925846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929edc34-f5a3-442b-a7c2-91b5790c4dad service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:12.931032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1883a8af324d4edcaa4b80f27ef94a85'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.934174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1883a8af324d4edcaa4b80f27ef94a85'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.935332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:12.936376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.936873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.937553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] PATH_INFO: `/v3/users/d2bfc3a4cdd340a9bd60ac5c8b011ef1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.939180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bfc3a4cdd340a9bd60ac5c8b011ef1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:12.942034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:12.949654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cf2cc09c-b8bf-48c1-8cdc-dd78c61cd85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1883a8af324d4edcaa4b80f27ef94a85'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:12.960296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 946/1896] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:12 2022] DELETE /identity/v3/users/1883a8af324d4edcaa4b80f27ef94a85 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:12.963709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:12.963876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:12.968059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:12.989804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:12.990884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:13.026011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bfc3a4cdd340a9bd60ac5c8b011ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.048605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bfc3a4cdd340a9bd60ac5c8b011ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.049825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bfc3a4cdd340a9bd60ac5c8b011ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.067761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 947/1897] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:13.080392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bfc3a4cdd340a9bd60ac5c8b011ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.080810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5c36e58f-9519-4ba1-9acb-e8a20a58a268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bfc3a4cdd340a9bd60ac5c8b011ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.090004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:13.092459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:13.107820 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 951/1898] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:12 2022] DELETE /identity/v3/users/d2bfc3a4cdd340a9bd60ac5c8b011ef1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:13.117392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:13.117689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:13.118109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:13.173987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:13.176761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675a10-a403-4d76-bda9-f7e0814523f3 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:13.184667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:13.285933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:13.286609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:13.286893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:13.287163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:13.290778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 952/1899] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:13.302963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:13.311531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:13.313792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:13.318856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a2a65-9fbe-48dd-8ea6-73d48bf675bb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:13.322636 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:13.333321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:13.334343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:13.334795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:13.335277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:13.346918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 948/1900] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:13.357934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:13.359492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:13.376950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 953/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:13.546901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:13.548934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:13.617730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f50ae-0f09-457e-bc65-39f35960f3af service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:13.653518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:13.655098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:13.655387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:13.658727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] PATH_INFO: `/v3/projects/859f32f91acf425eb662d007fca60b77` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:13.660378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859f32f91acf425eb662d007fca60b77)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:13.664107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:13.790668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859f32f91acf425eb662d007fca60b77', 'request_id': 'req-e33c53e6-9358-4095-a5c0-9f26c1489c45'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.804467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859f32f91acf425eb662d007fca60b77', 'request_id': 'req-e33c53e6-9358-4095-a5c0-9f26c1489c45'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.818717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859f32f91acf425eb662d007fca60b77', 'request_id': 'req-e33c53e6-9358-4095-a5c0-9f26c1489c45'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.841507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] The token cache is being invalidate because project 859f32f91acf425eb662d007fca60b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:13.841802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.842471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:13.844485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 949/1902] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:13 2022] DELETE /identity/v3/projects/859f32f91acf425eb662d007fca60b77 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:13.849078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:13.876257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc86bc-baa8-4a83-bc4b-47fe4bd1a720 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:13.961657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:13.985121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:13.985929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:13.986424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:13.986904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] PATH_INFO: `/v3/users/82d12ecf8d8d487e87da6f93854c5877` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:13.992679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d12ecf8d8d487e87da6f93854c5877)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:13.994838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:14.125123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:14.126752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:14.161330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c53e6-9358-4095-a5c0-9f26c1489c45 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:14.165151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d12ecf8d8d487e87da6f93854c5877'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.193276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:14.194452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:14.194904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:14.195235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] PATH_INFO: `/v3/projects/d28943895e654a6fa66e8efb981ad042` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:14.197648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28943895e654a6fa66e8efb981ad042)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:14.201609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:14.224928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d12ecf8d8d487e87da6f93854c5877'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.225965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d12ecf8d8d487e87da6f93854c5877'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.251050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d12ecf8d8d487e87da6f93854c5877'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.252003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d12ecf8d8d487e87da6f93854c5877'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.279210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 954/1903] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:13 2022] DELETE /identity/v3/users/82d12ecf8d8d487e87da6f93854c5877 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:14.335869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28943895e654a6fa66e8efb981ad042', 'request_id': 'req-37798085-2a95-46dd-8938-9ef9d88c26d6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.350785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28943895e654a6fa66e8efb981ad042', 'request_id': 'req-37798085-2a95-46dd-8938-9ef9d88c26d6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.372567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28943895e654a6fa66e8efb981ad042', 'request_id': 'req-37798085-2a95-46dd-8938-9ef9d88c26d6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.403560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:14.405379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:14.416257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] The token cache is being invalidate because project d28943895e654a6fa66e8efb981ad042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:14.416671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.425406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.430620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 950/1904] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:14 2022] DELETE /identity/v3/projects/d28943895e654a6fa66e8efb981ad042 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:14.433884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:14.448160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:14.524203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652663b9-6dc6-4156-9259-a995c19cb740 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:14.579095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37798085-2a95-46dd-8938-9ef9d88c26d6 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:14.586974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:14.588048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:14.588484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:14.588756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] PATH_INFO: `/v3/users/50cb0265ccd7440d83e0bc1a8cbfe2bd` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:14.589913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cb0265ccd7440d83e0bc1a8cbfe2bd)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:14.596113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:14.596113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:14.596113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:14.596113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] PATH_INFO: `/v3/projects/e162c055f2e54c80b2183e3b89d8b0b1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:14.596525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:14.596917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e162c055f2e54c80b2183e3b89d8b0b1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:14.599178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:14.604020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:14.622237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:14.659257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cb0265ccd7440d83e0bc1a8cbfe2bd'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.663709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e162c055f2e54c80b2183e3b89d8b0b1', 'request_id': 'req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.672861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e162c055f2e54c80b2183e3b89d8b0b1', 'request_id': 'req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.673553 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cb0265ccd7440d83e0bc1a8cbfe2bd'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.683474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e162c055f2e54c80b2183e3b89d8b0b1', 'request_id': 'req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.689522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cb0265ccd7440d83e0bc1a8cbfe2bd'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.692602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cb0265ccd7440d83e0bc1a8cbfe2bd'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.705459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] The token cache is being invalidate because project e162c055f2e54c80b2183e3b89d8b0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:14.705948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.707349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.713855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cb0265ccd7440d83e0bc1a8cbfe2bd'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.715573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 955/1905] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:14 2022] DELETE /identity/v3/projects/e162c055f2e54c80b2183e3b89d8b0b1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:14.719371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:14.721078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:14.723186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 951/1906] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:14 2022] DELETE /identity/v3/users/50cb0265ccd7440d83e0bc1a8cbfe2bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:14.798887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d2fb0-a027-4f5f-92aa-59f4f91ad321 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:14.889572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:14.890301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:14.890725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:14.891070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] PATH_INFO: `/v3/users/69c6adf52b3d4a1788d90ad7b23636a8` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:14.892727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c6adf52b3d4a1788d90ad7b23636a8)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:14.895405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:14.977636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c6adf52b3d4a1788d90ad7b23636a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.984588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:14.995285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c6adf52b3d4a1788d90ad7b23636a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:14.996124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c6adf52b3d4a1788d90ad7b23636a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.017510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c6adf52b3d4a1788d90ad7b23636a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.018243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d6397b8-5341-4d92-b473-246308087ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c6adf52b3d4a1788d90ad7b23636a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.048118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 956/1907] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:14 2022] DELETE /identity/v3/users/69c6adf52b3d4a1788d90ad7b23636a8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:15.052280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:15.054108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.074937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca752d-6baa-46a7-9741-78d93b2f5a1d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:15.156938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:15.157633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.157921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.158197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] PATH_INFO: `/v3/projects/2b530ba6dada4896903a961db4f4fd2a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.160840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b530ba6dada4896903a961db4f4fd2a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:15.162922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:15.219169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b530ba6dada4896903a961db4f4fd2a', 'request_id': 'req-9fac250b-50bd-4b7b-8ace-837c19494092'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.226502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b530ba6dada4896903a961db4f4fd2a', 'request_id': 'req-9fac250b-50bd-4b7b-8ace-837c19494092'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.236478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b530ba6dada4896903a961db4f4fd2a', 'request_id': 'req-9fac250b-50bd-4b7b-8ace-837c19494092'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.250852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] The token cache is being invalidate because project 2b530ba6dada4896903a961db4f4fd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:15.251395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.253039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.255659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 952/1908] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:15 2022] DELETE /identity/v3/projects/2b530ba6dada4896903a961db4f4fd2a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:15.261170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9087-0858-4c9f-96c3-e6dc4b58cc7e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.261622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9087-0858-4c9f-96c3-e6dc4b58cc7e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.262000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9087-0858-4c9f-96c3-e6dc4b58cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.294461 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-742e9087-0858-4c9f-96c3-e6dc4b58cc7e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:15.295997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-742e9087-0858-4c9f-96c3-e6dc4b58cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.303033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:15.304702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.325045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:15.446596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac250b-50bd-4b7b-8ace-837c19494092 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:15.448719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 957/1909] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:15.460292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.460585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.460930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.463067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:15.463782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.464151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.464400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] PATH_INFO: `/v3/projects/d91eb13ebcae472c96c08085fe4826c6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.470148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91eb13ebcae472c96c08085fe4826c6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:15.472155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:15.488599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:15.492219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.513855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 958/1910] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:15.521113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:15.545213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d706-3a36-4923-9b5e-ae1519d5afa9 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:15.552424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91eb13ebcae472c96c08085fe4826c6', 'request_id': 'req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.559600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91eb13ebcae472c96c08085fe4826c6', 'request_id': 'req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.571623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91eb13ebcae472c96c08085fe4826c6', 'request_id': 'req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.597984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] The token cache is being invalidate because project d91eb13ebcae472c96c08085fe4826c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:15.598745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.599705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-8809cdac-4cf0-4f0d-9884-56bc5a3e5948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.602657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 953/1911] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:15 2022] DELETE /identity/v3/projects/d91eb13ebcae472c96c08085fe4826c6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:15.604331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718934-2b8e-48c6-95b0-dc7457858ed8 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.604850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718934-2b8e-48c6-95b0-dc7457858ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.605315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718934-2b8e-48c6-95b0-dc7457858ed8 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.607266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 954/1912] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:38:15.608930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502d0b-cfea-4ab0-a376-f486c75e6c7b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.609370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502d0b-cfea-4ab0-a376-f486c75e6c7b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.609740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502d0b-cfea-4ab0-a376-f486c75e6c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.656427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6f502d0b-cfea-4ab0-a376-f486c75e6c7b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:15.658143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6f502d0b-cfea-4ab0-a376-f486c75e6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.716236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:15.718438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.718886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.719308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.720305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:15.720825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:15.725581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:15.752865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 959/1913] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:15.763640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:15.767918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.769125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 955/1914] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:15.770686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.771039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.771322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.797155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:15.798418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.831638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a47e-11fb-4953-9a56-dbccd956e292 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:15.840116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:15.841286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:15.842687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:15.843186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] PATH_INFO: `/v3/projects/78a82b2b5e844c27acd04b8924b60a35` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:15.845149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a82b2b5e844c27acd04b8924b60a35)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:15.849422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:15.885146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:15.936641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 956/1915] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:15.937475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:15.940598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:15.963643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a3a9b-0829-4ffe-a81c-901c622e72ba None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:15.969140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a82b2b5e844c27acd04b8924b60a35', 'request_id': 'req-2dd8493b-9dab-4285-aa4b-d3843aa36355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.975388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:15.979530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a82b2b5e844c27acd04b8924b60a35', 'request_id': 'req-2dd8493b-9dab-4285-aa4b-d3843aa36355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:15.992198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a82b2b5e844c27acd04b8924b60a35', 'request_id': 'req-2dd8493b-9dab-4285-aa4b-d3843aa36355'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:16.017544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] The token cache is being invalidate because project 78a82b2b5e844c27acd04b8924b60a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:16.018883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:16.019790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2dd8493b-9dab-4285-aa4b-d3843aa36355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:16.032796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 960/1916] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:15 2022] DELETE /identity/v3/projects/78a82b2b5e844c27acd04b8924b60a35 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:16.044454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d706bc-94a0-4761-8764-7e4defc32a8b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.044816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d706bc-94a0-4761-8764-7e4defc32a8b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.045098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d706bc-94a0-4761-8764-7e4defc32a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.077479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-37d706bc-94a0-4761-8764-7e4defc32a8b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:16.078696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37d706bc-94a0-4761-8764-7e4defc32a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.126105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.127028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.127305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.127610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.128241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.132067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.186934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 957/1917] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:15 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:16.186934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.202115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.231344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 961/1918] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:16.232776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.233014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.233317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.262717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:16.264190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.358789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc88199-6af1-477b-ac7b-59ee44142d73 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.358789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.358789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.358789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.359460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.359460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.375899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.379799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.396763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 958/1919] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:16.398459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.400110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.420319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673f5e-3275-431d-8124-dab6e2ae8431 service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.425261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 962/1920] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:16.426291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.426433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.427254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.427711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.428247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.429291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.431447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d3c5-f353-43fe-956d-cd75f6c61fd4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.456151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9416ea-68e7-41d2-9e93-b736a3d7b9b1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.471483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.472222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.472623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.472980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.473715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:16.474078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.475780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.487004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 959/1921] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:16.493286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.493643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.493991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.500587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 963/1922] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:16.502232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.525647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179effb-96f7-4919-bc97-a2cd5c9eab9e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.528881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:16.542236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:16.544897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.547568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.548607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.548959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.551226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.555515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.563029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 960/1923] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:16.568309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.588643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f103d-e6ca-4e64-8a2d-dae33a69ea68 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.592218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 964/1924] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:16.592218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.600626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.601488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.601864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.602231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.603902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.605400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.632347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3056-46bc-4d81-b521-53a56dc2c4fd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.649093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 961/1925] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:16.649387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.649387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.649387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.649387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.649792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:16.649792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.650966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.654176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.656778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:16.676395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 965/1926] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:16.677643 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.712075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca81bf-a77f-4fad-b279-f255935742b0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.795571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36e00-fc1e-4e5a-ae75-8a2870e5926a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.809988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.810615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.810891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.811161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.811844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.813436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.829812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 962/1927] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:16.829812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.839940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:16.842029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6cd9-445b-4691-b55a-6ddf3c0fd91b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.852946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.853908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.854398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.862347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.863907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.866073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.867702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.868631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.869083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.869598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.870411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.872893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.901406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 966/1928] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:16.902522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.914431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852a76-238f-4138-bc2f-ae24d7e8ca3c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:16.920103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:16.921097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:16.921384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:16.921659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] PATH_INFO: `/v3/projects/092b658ac0e44f3db8183b711032c571/users/8a39bb9cec684ae7899de3962c99db14/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:16.940568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 963/1929] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:16.942035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:16.944236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=092b658ac0e44f3db8183b711032c571, user_id=8a39bb9cec684ae7899de3962c99db14, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:16.947877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:16.967591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 967/1930] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:16 2022] PUT /identity/v3/projects/092b658ac0e44f3db8183b711032c571/users/8a39bb9cec684ae7899de3962c99db14/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:16.968431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.058876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b56e9-1e8b-4c04-bad5-f9c302617b7b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.136945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7d99-1b8f-4a8b-a9b3-924a42cebc4a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.141929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.142828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.143109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.143378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.146740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.166872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6b97b-16fc-4ce7-a08d-9fd3e40f9b19 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.180323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.181654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.182149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.182630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.184131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.187129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.210514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 968/1931] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:16 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:17.210514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef738102-0922-479b-ac95-cac9f475487a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.210514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef738102-0922-479b-ac95-cac9f475487a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.210514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef738102-0922-479b-ac95-cac9f475487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.218880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 964/1932] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:17.221100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.234259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35194-d80e-4445-bc3d-3861133e2fb2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.242081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.242756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.242985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.243258 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.244068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.245678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.264180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 965/1933] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:17.264180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.272953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f56b4-235f-4201-841d-cf9a026a6604 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.273565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ef738102-0922-479b-ac95-cac9f475487a None None] MFA Rules not processed for user `8a39bb9cec684ae7899de3962c99db14`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:17.274858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ef738102-0922-479b-ac95-cac9f475487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:17.278385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.279170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.279697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.280270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.281118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.283026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.290718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:17.302879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 966/1934] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:17.304775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.319327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e929f8-644c-45a4-9b84-bff88edb4eab admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.325560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.326456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.326899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.327318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.328547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.331106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.351926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 967/1935] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:17.354126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.372650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1554f78-a4e3-4b2b-b069-a05db686dc8c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.380596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.381748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.382562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.383864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] PATH_INFO: `/v3/projects/858a987d990740878a5c1f3f5e496346/users/cebc0824c0a14345859012d8ad62c1b7/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.403657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 969/1936] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:17.406407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef738102-0922-479b-ac95-cac9f475487a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.410896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=858a987d990740878a5c1f3f5e496346, user_id=cebc0824c0a14345859012d8ad62c1b7, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.416670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.436602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef738102-0922-479b-ac95-cac9f475487a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.440921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 968/1937] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:17 2022] PUT /identity/v3/projects/858a987d990740878a5c1f3f5e496346/users/cebc0824c0a14345859012d8ad62c1b7/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:17.441972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.522523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:17.564791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbbb89-7b02-4dda-a310-e287d3384e8c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:17.586694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.588929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.590642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.591761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.593411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.603603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:17.603797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d849f-c5d6-4357-872e-68948ab883b6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.603909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.603909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.603909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] PATH_INFO: `/v3/projects/37f717dae7b84064ad50637fd3d5dfbd/users/9d682923ffe841c78a409dc1f82bc6fc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.629558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f717dae7b84064ad50637fd3d5dfbd, user_id=9d682923ffe841c78a409dc1f82bc6fc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:17.629873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3250f2b-6ae6-4241-bda5-689b1f8c6f24 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:17.651578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 970/1938] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:17 2022] PUT /identity/v3/projects/37f717dae7b84064ad50637fd3d5dfbd/users/9d682923ffe841c78a409dc1f82bc6fc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:17.651578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.651864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.652112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.680385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 969/1939] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:17.685308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:17.687081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:17.687450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:17.690454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] MFA Rules not processed for user `cebc0824c0a14345859012d8ad62c1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:17.691955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:17.745842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] MFA Rules not processed for user `9d682923ffe841c78a409dc1f82bc6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:17.750645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:17.835655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 971/1940] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:17.835655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.913226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 970/1941] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:17.914235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:17.991330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:18.000110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e09c44-395e-4811-bd78-5b0e5a6fd0cc None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.011684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.012775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.014497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.014980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.015888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.021209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.030161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5e20-722d-4e49-a6cb-4c260e7cd52b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.068135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.068135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.068441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.068614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.069301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.071221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.077490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 972/1942] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:18.078172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.087436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.124336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 971/1943] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:17 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:18.126113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.147387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:18.194853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a21-595b-4760-9e5e-5d3ec89cf28e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.261886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899bba-8e75-4c48-8e05-3eb4fb19990c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.270031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.270661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.270937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.271208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.279840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.282446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.306493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 972/1944] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:18.307581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.324320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.324968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.325248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.325518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.326635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e2708-693c-427d-b07b-18dc9eb24a38 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.332559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.333565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.333847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.334116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.335490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.337996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.369224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 973/1945] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:18 2022] POST /identity/v3/users => generated 291 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:18.373398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.375146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.389716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db332-c7a4-42ee-ac0c-b29c2fd0e6b9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.395175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.395860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.396207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.396469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] PATH_INFO: `/v3/users/92fd19ef17b1495fbb65be897d65c54d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.397622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fd19ef17b1495fbb65be897d65c54d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.401088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.449995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.452310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.464833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 973/1946] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:18.465560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fd19ef17b1495fbb65be897d65c54d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.465941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.477574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f85516-b502-4aa4-a5ea-1d1325541c9f service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.479301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fd19ef17b1495fbb65be897d65c54d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.483009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.483936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.484289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.484722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] PATH_INFO: `/v3/projects/fd37ffdc9d4a481c922309480d89c98e/users/c1e81f84e79a40fbafa21dc313516b6b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.489978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fd19ef17b1495fbb65be897d65c54d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.490948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fd19ef17b1495fbb65be897d65c54d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.499367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fd19ef17b1495fbb65be897d65c54d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.506056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd37ffdc9d4a481c922309480d89c98e, user_id=c1e81f84e79a40fbafa21dc313516b6b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.509982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 974/1947] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:18 2022] DELETE /identity/v3/users/92fd19ef17b1495fbb65be897d65c54d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:18.509982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.510180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.517439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.525179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 974/1948] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:18 2022] PUT /identity/v3/projects/fd37ffdc9d4a481c922309480d89c98e/users/c1e81f84e79a40fbafa21dc313516b6b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:18.526609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.528479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.535033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:18.591078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdd8ba-2806-45ca-a730-e5f9c72f8ad7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.594167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba633c-e8c6-4ff6-a8a8-0cc98518f16b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.599674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.600235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.600383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.600557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.600822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.601469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.601708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.602344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.602630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] PATH_INFO: `/v3/users/9d682923ffe841c78a409dc1f82bc6fc` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.603076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12dd06-e53a-40b5-92f9-7f77de3d3a9b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.607267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d682923ffe841c78a409dc1f82bc6fc)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.609301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.614777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 975/1949] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:18.616014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.616296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.616563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.635742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:18.636648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:18.636953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.649394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 976/1950] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:18.650764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.652142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.666662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e734ac0-27a5-4724-91b8-0d6b6490e2d5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.675906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.676545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.676819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.677083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.677726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.678041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d682923ffe841c78a409dc1f82bc6fc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.679361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.690141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 977/1951] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:18.690978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.695592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d682923ffe841c78a409dc1f82bc6fc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.696611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d682923ffe841c78a409dc1f82bc6fc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.702632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83bf3-aa7d-4ca6-903e-9fa4bbec7a8a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.708216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.708860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.709150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.709482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] PATH_INFO: `/v3/projects/9798a5d6b5d44c5b8919fe858865c26b/users/019a4b2635b741b282a41a7588d7cfb1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.717021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d682923ffe841c78a409dc1f82bc6fc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.717728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d682923ffe841c78a409dc1f82bc6fc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:18.730065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9798a5d6b5d44c5b8919fe858865c26b, user_id=019a4b2635b741b282a41a7588d7cfb1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.732940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.739427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 975/1952] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:18 2022] DELETE /identity/v3/users/9d682923ffe841c78a409dc1f82bc6fc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:18.741357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.743381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.755522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 978/1953] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:18 2022] PUT /identity/v3/projects/9798a5d6b5d44c5b8919fe858865c26b/users/019a4b2635b741b282a41a7588d7cfb1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:18.756425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.759958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.836048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b1283-75d9-4335-a723-ef7b7a785908 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.855502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b0e8-d45a-49bd-8b31-ef1bbf86967f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:18.859171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.859964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.860327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.860663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] PATH_INFO: `/v3/projects/fd37ffdc9d4a481c922309480d89c98e/users/c1e81f84e79a40fbafa21dc313516b6b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.862738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd37ffdc9d4a481c922309480d89c98e, user_id=c1e81f84e79a40fbafa21dc313516b6b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.866025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ffb56-3de3-4fc8-929e-19e360979366 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.897586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:18.898494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.898945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.899356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.909628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 979/1954] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:18 2022] PUT /identity/v3/projects/fd37ffdc9d4a481c922309480d89c98e/users/c1e81f84e79a40fbafa21dc313516b6b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:18.909628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637959a-f578-41e8-b1bc-d6addb9fac10 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:18.909628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637959a-f578-41e8-b1bc-d6addb9fac10 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:18.910516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.910600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637959a-f578-41e8-b1bc-d6addb9fac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:18.918879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:18.920918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:18.925208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8637959a-f578-41e8-b1bc-d6addb9fac10 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:18.931957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8637959a-f578-41e8-b1bc-d6addb9fac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.934500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 976/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:18.952296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:18.955974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:18.978152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc450-d65b-4471-a5d8-d3d318e1e3a3 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.054851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 980/1956] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:19.056539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.057178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.066423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.077898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:19.082146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:19.085817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.086736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.087132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.087476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.088271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.090675 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.125094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 977/1957] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:19.125997 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:19.128625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.137016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] MFA Rules not processed for user `c1e81f84e79a40fbafa21dc313516b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:19.138617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.241277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9eee-9385-4af6-b364-55330ef0a386 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.252915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.253584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.253866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.254142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.294044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.296171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.315746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 981/1958] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:19.321917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:19.322700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 978/1959] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:19.331082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:19.333488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.357009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8f4b-6128-4af8-ad11-a459c4f39ee9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.364599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.365514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.365949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.366222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] PATH_INFO: `/v3/projects/9798a5d6b5d44c5b8919fe858865c26b/users/019a4b2635b741b282a41a7588d7cfb1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.370697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9798a5d6b5d44c5b8919fe858865c26b, user_id=019a4b2635b741b282a41a7588d7cfb1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.377865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71fec5-2f19-4974-b3db-af4049441bcb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.400665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 982/1960] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:19 2022] PUT /identity/v3/projects/9798a5d6b5d44c5b8919fe858865c26b/users/019a4b2635b741b282a41a7588d7cfb1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:19.403248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.403721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.404079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.466396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] MFA Rules not processed for user `019a4b2635b741b282a41a7588d7cfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:19.475690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.508756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08dbb-88be-4755-92d6-143953f04064 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.654077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.654706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.654992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.655264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.689627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 983/1961] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:19.690435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:19.693104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.868638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.870790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.879725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cfdb4-ce20-4a39-bf10-bf3a4945dc9c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.889956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.890628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.890739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 979/1962] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:19.890950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.891175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] PATH_INFO: `/v3/projects/578adae40fc14f07b92bbf8fe9d38c72` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.891499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:19.892732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=578adae40fc14f07b92bbf8fe9d38c72)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.892857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:19.894585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.896543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:19.899659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:19.916348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25305e-768c-4697-8611-2d8171bbc641 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:19.930103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:19.930849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:19.931194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:19.931535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:19.949970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:19.951446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:19.979849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 980/1963] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:19.980874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578adae40fc14f07b92bbf8fe9d38c72', 'request_id': 'req-84afddd7-5596-44fa-ad9f-12d8ced6a80c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:19.997187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578adae40fc14f07b92bbf8fe9d38c72', 'request_id': 'req-84afddd7-5596-44fa-ad9f-12d8ced6a80c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.018534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578adae40fc14f07b92bbf8fe9d38c72', 'request_id': 'req-84afddd7-5596-44fa-ad9f-12d8ced6a80c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.046519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] The token cache is being invalidate because project 578adae40fc14f07b92bbf8fe9d38c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:20.050178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.051346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.055798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 984/1964] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:19 2022] DELETE /identity/v3/projects/578adae40fc14f07b92bbf8fe9d38c72 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:20.067887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.080260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.081687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d013541-40f4-42da-ad76-79ca1fccda9a service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.082412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.217967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.218980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.219333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.219759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] PATH_INFO: `/v3/users/e91106b3bb6e4d369760c3bf60bd8222` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.219871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afddd7-5596-44fa-ad9f-12d8ced6a80c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.221098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91106b3bb6e4d369760c3bf60bd8222)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.223901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.230995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.231743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.235130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.235515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.237477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.333155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91106b3bb6e4d369760c3bf60bd8222'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.354234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.364975 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91106b3bb6e4d369760c3bf60bd8222'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.365987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91106b3bb6e4d369760c3bf60bd8222'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.367791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.380241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 985/1965] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:20.381111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.382581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.389692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91106b3bb6e4d369760c3bf60bd8222'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.390492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c72b7c11-b4b0-4175-b8b4-c361f86d5d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91106b3bb6e4d369760c3bf60bd8222'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.410898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4044b9-855a-4736-8fed-6151888fbf3c service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.424861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.426235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.426521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.426802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] PATH_INFO: `/v3/projects/37f717dae7b84064ad50637fd3d5dfbd` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.428696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f717dae7b84064ad50637fd3d5dfbd)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.428998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 981/1966] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:20 2022] DELETE /identity/v3/users/e91106b3bb6e4d369760c3bf60bd8222 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:20.438022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.520125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:20.536642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f717dae7b84064ad50637fd3d5dfbd', 'request_id': 'req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.556115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f717dae7b84064ad50637fd3d5dfbd', 'request_id': 'req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.572956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f717dae7b84064ad50637fd3d5dfbd', 'request_id': 'req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.614911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] The token cache is being invalidate because project 37f717dae7b84064ad50637fd3d5dfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:20.615213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.618694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:20.620852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 986/1967] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:20 2022] DELETE /identity/v3/projects/37f717dae7b84064ad50637fd3d5dfbd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:20.625805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fdf07-6814-467a-88b3-ad2dd9b33f52 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.626207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fdf07-6814-467a-88b3-ad2dd9b33f52 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.626526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fdf07-6814-467a-88b3-ad2dd9b33f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.654373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.656146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.664457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-924fdf07-6814-467a-88b3-ad2dd9b33f52 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:20.666608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-924fdf07-6814-467a-88b3-ad2dd9b33f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.795589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 982/1968] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:20.808780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.809109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.809329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.813528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2c244-d288-4fdf-a717-6960c1f6f2ac admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.825242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e81f84e79a40fbafa21dc313516b6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd37ffdc9d4a481c922309480d89c98e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.826183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.826469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.826750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.827416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:20.827821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.829774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.846325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:20.848247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:20.851196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 987/1969] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:38:20.852640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.869212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 983/1970] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:20.871966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.877815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:20.888174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dffa1a-7ef4-43a3-96c4-131dc11bb352 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.889601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605f566-e2ba-4a12-af31-1a226e5fe185 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.904618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.905454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.905970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.906346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.907075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e81f84e79a40fbafa21dc313516b6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd37ffdc9d4a481c922309480d89c98e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.907211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:20.907473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.907616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.907843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.908133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.908798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.914430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.915397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.929320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 984/1971] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:20.934072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:20.955908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe775-d5ed-4883-b663-35eb37223577 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:20.965505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 988/1972] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:20 2022] POST /identity/v3/projects => generated 352 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:20.965821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:20.965821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:20.965821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:20.965821 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:20.966126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:20.967112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:20.968056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.018113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 985/1973] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:20 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:21.022735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.043412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48db0-52b4-43cd-a09a-c32131f0465e tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.112792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.133495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e81f84e79a40fbafa21dc313516b6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd37ffdc9d4a481c922309480d89c98e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.134409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.134929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.135416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.136173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:21.136478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.136620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2bad-da99-4ad1-a92f-3fae24a9b3e4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.138124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.141229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.141886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.142179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.142430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.143076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.145763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.150490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 989/1974] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:21.151489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.153244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.168146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 986/1975] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:21.169963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701862-a47b-4643-bc47-9f0ef3c8e8c5 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.172348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.177392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.178465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.179136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.179932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] PATH_INFO: `/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.181945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03f0213a66d4cd3bee511ad7f4ae2ee)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.183168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193ef03-a816-4863-aa77-bd4102a5f6a7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.185173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.188588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.189183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.189458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.189727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.190365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.197716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.203979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 987/1976] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:21.204664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.216258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da5da2-fb76-47c2-ab5b-b8ee80d77f74 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.221334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e81f84e79a40fbafa21dc313516b6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd37ffdc9d4a481c922309480d89c98e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.222193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.222477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.222753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] PATH_INFO: `/v3/projects/c3e87c4f08894f9fbe9a87a2493f5f9e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.223907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3e87c4f08894f9fbe9a87a2493f5f9e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.225782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.239599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03f0213a66d4cd3bee511ad7f4ae2ee', 'request_id': 'req-3260f64c-26af-4d66-8e49-faabcd745488'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.245047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03f0213a66d4cd3bee511ad7f4ae2ee', 'request_id': 'req-3260f64c-26af-4d66-8e49-faabcd745488'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.256598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03f0213a66d4cd3bee511ad7f4ae2ee', 'request_id': 'req-3260f64c-26af-4d66-8e49-faabcd745488'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.268752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] The token cache is being invalidate because project e03f0213a66d4cd3bee511ad7f4ae2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:21.269109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.270723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.272309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 990/1977] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:21 2022] DELETE /identity/v3/projects/e03f0213a66d4cd3bee511ad7f4ae2ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:21.279066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.279895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e87c4f08894f9fbe9a87a2493f5f9e', 'request_id': 'req-9935b12b-b78c-450a-8a16-1d6dec780030'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.280944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.285949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e87c4f08894f9fbe9a87a2493f5f9e', 'request_id': 'req-9935b12b-b78c-450a-8a16-1d6dec780030'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.294921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e87c4f08894f9fbe9a87a2493f5f9e', 'request_id': 'req-9935b12b-b78c-450a-8a16-1d6dec780030'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.309370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] The token cache is being invalidate because project c3e87c4f08894f9fbe9a87a2493f5f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:21.309660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.310327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9935b12b-b78c-450a-8a16-1d6dec780030 tempest-VolumeQuotaClassesTest-1645888471 tempest-VolumeQuotaClassesTest-1645888471-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.311888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 988/1978] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:21 2022] DELETE /identity/v3/projects/c3e87c4f08894f9fbe9a87a2493f5f9e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:21.315508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2c09-fd40-4b9b-a108-5b7589f88a10 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.315508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2c09-fd40-4b9b-a108-5b7589f88a10 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.315508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd2c09-fd40-4b9b-a108-5b7589f88a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.348832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-dddd2c09-fd40-4b9b-a108-5b7589f88a10 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:21.350031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dddd2c09-fd40-4b9b-a108-5b7589f88a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.367728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260f64c-26af-4d66-8e49-faabcd745488 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.377095 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.427026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 989/1979] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:21.428423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.428718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.428992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.440318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.441878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.442302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.442667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.443415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.445434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.462968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 991/1980] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:21.464021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.466308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.480733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41c07-0691-40aa-ad82-8866aa1eefad admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.486366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.487101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.487381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.488236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] PATH_INFO: `/v3/projects/00bb2f8026d54944badde35ef97f616b/users/f8c09e26a0e24d05a89dcd30cc296ffc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.494248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.503234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:21.505708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.521765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bb2f8026d54944badde35ef97f616b, user_id=f8c09e26a0e24d05a89dcd30cc296ffc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.524569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 990/1981] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:21.525520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708ac61-57a1-4fc0-ba7e-074b63981aab admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.530246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.541816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce488-d22d-49dd-8034-f41bf3efc39d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.555679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 992/1982] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:21 2022] PUT /identity/v3/projects/00bb2f8026d54944badde35ef97f616b/users/f8c09e26a0e24d05a89dcd30cc296ffc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:21.557802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.558088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.558358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.591332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] MFA Rules not processed for user `f8c09e26a0e24d05a89dcd30cc296ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:21.592595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.617640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.618494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.618928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.619355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.620196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:21.620751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.622495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.636285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 991/1983] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:21.637465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.639729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.652470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b21a5e-569c-4970-bf2d-cc911bf67cc4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.657688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.658547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.658977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.659397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] PATH_INFO: `/v3/users/8a39bb9cec684ae7899de3962c99db14` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.664785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a39bb9cec684ae7899de3962c99db14)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.666952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.671639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 993/1984] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:21.672690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.686750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840bf4-922c-4960-8f21-5df346756f98 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.692940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.693916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.694413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.694891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.695742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.698686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:21.745451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a39bb9cec684ae7899de3962c99db14'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.746762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 994/1985] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:21.747809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.773438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a39bb9cec684ae7899de3962c99db14'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.774253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a39bb9cec684ae7899de3962c99db14'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.792867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a39bb9cec684ae7899de3962c99db14'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.793627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a39bb9cec684ae7899de3962c99db14'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:21.819435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 992/1986] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:21 2022] DELETE /identity/v3/users/8a39bb9cec684ae7899de3962c99db14 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:21.821579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:21.825641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:21.843299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a046-8cb2-4fc6-904e-dd3f528461dc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:21.907327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.974303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.986079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:21.987157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:21.989518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:21.990040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:21.991014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:21.993425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f36ef-0f8c-42d4-9119-9d6b8bd941e7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.003444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039afd-737f-45e4-a681-c042dc91e5a9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.012830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.015672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.015909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.016181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.016883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.025945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.044629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 995/1987] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:22.046047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.046311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.046667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.069347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 993/1988] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:21 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:22.069347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.070586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.092222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0fe6-e3bc-4e34-977e-a5342140d7f8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.093009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:22.094333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.240304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.240973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.241377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.241710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.242339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.244468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.283736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 994/1989] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:22.285297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.290902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 996/1990] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:22.292741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.304384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c2fd9-58ce-464a-9e15-d1ead736720c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.309040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d484ca-5978-4780-b205-ce0b6c13b760 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.309774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.310543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.310929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.311193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.311959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.313750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.317261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.317970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.318244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.318514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.319198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.321800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.344272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 997/1991] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:22.345449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.347996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.360547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 995/1992] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:22.365315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.386512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f47b-d638-4bd4-956c-ee2a6a298ea9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.400894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.401587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.401863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.402130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] PATH_INFO: `/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5/users/978398a05a154034a52dc5150a7f099b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.420179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3cdea-6d4f-4b91-9d3b-18a149c98b70 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.424579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.425844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.426119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.426396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.436872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.438465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.439413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffcf7f970cd45329234e4c2d3c9fbe5, user_id=978398a05a154034a52dc5150a7f099b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.442845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.456052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 998/1993] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:22.456978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.470311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 996/1994] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:22 2022] PUT /identity/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5/users/978398a05a154034a52dc5150a7f099b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:22.476861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.478469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ccb8-6de1-418c-9214-bd3f4ec4b9b0 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.586497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.587171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.587449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.587819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.588475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.590843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.603997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 999/1995] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:22.608326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.629667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc36b-f67d-4f0b-af5b-98f9716f9114 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.636794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.637556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.637906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.638293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] PATH_INFO: `/v3/projects/dfe92cbcbcab4b3db82c9bbd04d46782/users/1c59a1669d7c41cd9800f29400317a22/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.641979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699656b7-f288-42c9-94f9-a013c8a6b3f7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.649529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:22.657797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe92cbcbcab4b3db82c9bbd04d46782, user_id=1c59a1669d7c41cd9800f29400317a22, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.660499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.661759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.662252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549bc5-ec67-427b-ba53-f96651f7df4b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.662937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.664081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.664754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.667126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.684207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 997/1996] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:22.685118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.685553 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1000/1997] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:22 2022] PUT /identity/v3/projects/dfe92cbcbcab4b3db82c9bbd04d46782/users/1c59a1669d7c41cd9800f29400317a22/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:22.696040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86cd6a-3385-44d8-8a12-0958d01cc2da admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.696467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.697949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.698980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.703241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:22.738358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] MFA Rules not processed for user `1c59a1669d7c41cd9800f29400317a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:22.739609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.799004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.799708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.799985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.800822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] PATH_INFO: `/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5/users/978398a05a154034a52dc5150a7f099b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.806963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffcf7f970cd45329234e4c2d3c9fbe5, user_id=978398a05a154034a52dc5150a7f099b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.812120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531c541-7e64-4ba1-afd6-d917cc0fe214 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.838996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 998/1998] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:22 2022] PUT /identity/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5/users/978398a05a154034a52dc5150a7f099b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:22.842522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.842808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.843103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.855700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1001/1999] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:22.859941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.873808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca51d7-9024-4694-985e-3cc615ff1734 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:22.891666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] MFA Rules not processed for user `978398a05a154034a52dc5150a7f099b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:22.892875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.945859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:22.946493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:22.946772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:22.947047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:22.947697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:22.949622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:22.983132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1002/2000] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:22.983132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.983414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 999/2001] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:22.983414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:22.984783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:22.995450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31d7f1-b75e-4165-8dd1-6fa918336eda None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.054680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488fdc-0af3-4cd3-b92a-b3c7819e055c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.056127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.056734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.057083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.057266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.057886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.059737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.059875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.060389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.060674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.060948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] PATH_INFO: `/v3/projects/092b658ac0e44f3db8183b711032c571` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.062081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092b658ac0e44f3db8183b711032c571)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.064009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.067148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:23.087572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1000/2002] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:22 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:23.087572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.088709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.112132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:23.129766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092b658ac0e44f3db8183b711032c571', 'request_id': 'req-f02778a1-fe5b-44fe-84d2-217e87416401'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.143668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092b658ac0e44f3db8183b711032c571', 'request_id': 'req-f02778a1-fe5b-44fe-84d2-217e87416401'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.153698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092b658ac0e44f3db8183b711032c571', 'request_id': 'req-f02778a1-fe5b-44fe-84d2-217e87416401'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.163771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7fdbc-4f59-4094-89f1-a75b1b1c4e78 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.168017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] The token cache is being invalidate because project 092b658ac0e44f3db8183b711032c571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:23.168315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.169271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.171889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1003/2003] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:22 2022] DELETE /identity/v3/projects/092b658ac0e44f3db8183b711032c571 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:23.172190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.174043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.227633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.228245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.228523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.228796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.232928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.262513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02778a1-fe5b-44fe-84d2-217e87416401 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.267778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.269660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.270000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.273219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.273219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.273219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.285144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1004/2004] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:23.286001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.289878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.298375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.298375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.306589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e211d2e-ecca-4cb5-b674-25a08b8c25dc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.310780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1001/2005] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:23.311436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.313140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.313952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.314337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.314709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] PATH_INFO: `/v3/users/c1e81f84e79a40fbafa21dc313516b6b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.316583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e81f84e79a40fbafa21dc313516b6b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.318745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.323496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f9513-bc20-4a29-9021-0fd366d578c9 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.329803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.330475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.330798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.331078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] PATH_INFO: `/v3/projects/9c1c9e7151eb48b7a078048370082c91/users/a23b51b5f3bc48c1884374280869001b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.353688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1c9e7151eb48b7a078048370082c91, user_id=a23b51b5f3bc48c1884374280869001b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.357798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.379987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1002/2006] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:23 2022] PUT /identity/v3/projects/9c1c9e7151eb48b7a078048370082c91/users/a23b51b5f3bc48c1884374280869001b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:23.385469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.411018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e81f84e79a40fbafa21dc313516b6b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.432992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e81f84e79a40fbafa21dc313516b6b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.448177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e81f84e79a40fbafa21dc313516b6b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.450095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e81f84e79a40fbafa21dc313516b6b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.464250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e81f84e79a40fbafa21dc313516b6b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:23.469138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:23.486935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1005/2007] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:23 2022] DELETE /identity/v3/users/c1e81f84e79a40fbafa21dc313516b6b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:23.497786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34df8-a7bd-4fdf-88cc-c75022ef4c50 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.510292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:23.616527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.617156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.617565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.617801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.618371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.620173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ada1b-8d84-45fa-a737-1f13e7d661bd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.639733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1003/2008] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:23.641919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.644306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.665678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad599-336a-45ba-9433-2a229b82119d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:23.678110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:23.678110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.679787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.680198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] PATH_INFO: `/v3/projects/9c1c9e7151eb48b7a078048370082c91/users/a23b51b5f3bc48c1884374280869001b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.688080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1c9e7151eb48b7a078048370082c91, user_id=a23b51b5f3bc48c1884374280869001b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:23.691928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:23.720265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1006/2009] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:23 2022] PUT /identity/v3/projects/9c1c9e7151eb48b7a078048370082c91/users/a23b51b5f3bc48c1884374280869001b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:23.731611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:23.732021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:23.732370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:23.793064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] MFA Rules not processed for user `a23b51b5f3bc48c1884374280869001b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:23.794223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:23.929704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1004/2010] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:23.945873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:23.948531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.042714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5350b-1962-4daf-af67-ea7de06b5327 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:24.046682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:24.047237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.047516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.047993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.070545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:24.072030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:24.083346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1007/2011] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:24.218090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:24.228984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5c7fe-881c-43ab-a92b-0a2a4e8f2b0e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:24.233866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:24.234649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.234937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.235190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.237062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.310000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:24.311902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca3ae7-7f40-456d-9c90-7c5d25336a08 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:24.327034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1005/2012] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:24.337127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:24.339257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.441038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a3a6-2bf9-458c-8b67-5fcb296e3943 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:24.447571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:24.450105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.450475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.451164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] PATH_INFO: `/v3/projects/fd37ffdc9d4a481c922309480d89c98e` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.452583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd37ffdc9d4a481c922309480d89c98e)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:24.457024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:24.556980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd37ffdc9d4a481c922309480d89c98e', 'request_id': 'req-b1520c13-c7a5-4d8e-a42b-c72b851ed471'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:24.567334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd37ffdc9d4a481c922309480d89c98e', 'request_id': 'req-b1520c13-c7a5-4d8e-a42b-c72b851ed471'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:24.583785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd37ffdc9d4a481c922309480d89c98e', 'request_id': 'req-b1520c13-c7a5-4d8e-a42b-c72b851ed471'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:24.607808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] The token cache is being invalidate because project fd37ffdc9d4a481c922309480d89c98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:24.608244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:24.611347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:24.613454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1008/2013] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:24 2022] DELETE /identity/v3/projects/fd37ffdc9d4a481c922309480d89c98e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:24.618475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d1be-3dc5-4916-8ec9-b0bb4e011cc9 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.618936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d1be-3dc5-4916-8ec9-b0bb4e011cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.619040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d1be-3dc5-4916-8ec9-b0bb4e011cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.640565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0b31d1be-3dc5-4916-8ec9-b0bb4e011cc9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:24.641804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0b31d1be-3dc5-4916-8ec9-b0bb4e011cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.683204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:24.700412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:24.702012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.767718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1006/2014] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:24.770066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.770348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.771939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.773274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:24.796548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:24.798001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.828514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1007/2015] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:24.829640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:24.833695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:24.865047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bed5-cee0-4f43-af19-4c214286ab1b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:24.873866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520c13-c7a5-4d8e-a42b-c72b851ed471 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:24.878918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:24.879994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.881365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.881858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] PATH_INFO: `/v3/users/1c59a1669d7c41cd9800f29400317a22` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.885128 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c59a1669d7c41cd9800f29400317a22)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:24.888072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:24.888876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:24.889567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:24.889903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:24.890180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] PATH_INFO: `/v3/users/cebc0824c0a14345859012d8ad62c1b7` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:24.894500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebc0824c0a14345859012d8ad62c1b7)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:24.904189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:24.999020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c59a1669d7c41cd9800f29400317a22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.030038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebc0824c0a14345859012d8ad62c1b7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.039149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c59a1669d7c41cd9800f29400317a22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.040337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c59a1669d7c41cd9800f29400317a22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.064726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebc0824c0a14345859012d8ad62c1b7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.071422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c59a1669d7c41cd9800f29400317a22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.073197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c59a1669d7c41cd9800f29400317a22'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.085673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebc0824c0a14345859012d8ad62c1b7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.085673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebc0824c0a14345859012d8ad62c1b7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.099186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d5ceffe-3bed-426d-aa95-e7901cae8396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebc0824c0a14345859012d8ad62c1b7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:25.101477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1008/2016] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:24 2022] DELETE /identity/v3/users/1c59a1669d7c41cd9800f29400317a22 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:25.104800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.107925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.115095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1009/2017] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:24 2022] DELETE /identity/v3/users/cebc0824c0a14345859012d8ad62c1b7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:25.122513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55422-4edd-4485-9f9c-81312f7ed504 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.122816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55422-4edd-4485-9f9c-81312f7ed504 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.123067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55422-4edd-4485-9f9c-81312f7ed504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.155742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-64b55422-4edd-4485-9f9c-81312f7ed504 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:25.161259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-64b55422-4edd-4485-9f9c-81312f7ed504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.266499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a1571-fc6c-4810-9ea7-531bf1a878ab admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.314259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1010/2018] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:25.314259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.314259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.314259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.333222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:25.335697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.351971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1011/2019] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:25.357256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:25.380877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.383026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.411136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.412084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.412206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.412553 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.413271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:25.413644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.415748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.453802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1009/2020] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:25.454994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.460786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.466351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:25.517450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6548fa5-8bc5-4830-b41d-7648efa7d427 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.522113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.522804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.523036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.523275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.546964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.548574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.579464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575130e4-b539-40c8-b504-b528738ab706 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.581275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1012/2021] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:25.582272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.584055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:25.590561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.591354 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.591756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.592156 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.613676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc4db8-283a-4360-acd9-a498d0549d55 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.622705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.624600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.630737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.631365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.631702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.631944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.632576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.634487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.639973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1010/2022] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:25.699669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1013/2023] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:25 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:25.704650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.716551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65d0cc-8a15-49a9-a29e-0f4d00e94506 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.880010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.880733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.881045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.881496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.882123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.884279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.909988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1011/2024] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:25 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:25.911312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.922243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb6e4b-bffe-4153-92de-ffe6680d46c2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.927630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.928310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.928679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.929021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.929753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.931339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.942302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1014/2025] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:25.946979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.957290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4e1bf-03de-4e36-97b7-3cb1152882ea admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.962809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.963412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.963794 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.964068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:25.964712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:25.966311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e56a8-82b0-43d0-8b4c-5bdc810c92df admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:25.979850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1012/2026] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:25.981195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:25.991963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53fff-8eda-4dbd-90ea-055316b416b8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:25.997366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:25.998038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:25.998319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:25.998719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] PATH_INFO: `/v3/projects/ed70962529784a9695eab979a06cdf8b/users/a647853e962c4ed7b65fea5a4e66ba1c/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.018274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed70962529784a9695eab979a06cdf8b, user_id=a647853e962c4ed7b65fea5a4e66ba1c, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.021317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.037626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1015/2027] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:25 2022] PUT /identity/v3/projects/ed70962529784a9695eab979a06cdf8b/users/a647853e962c4ed7b65fea5a4e66ba1c/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.048289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.048802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.048943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.070672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.074020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.082951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] MFA Rules not processed for user `a647853e962c4ed7b65fea5a4e66ba1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:26.084101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.167833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:26.195535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1013/2028] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:26.196606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.197855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.202051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d2dc-9b47-4860-bcc3-8bc11c72319f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.206854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.207534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.208073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.208349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] PATH_INFO: `/v3/projects/dfe92cbcbcab4b3db82c9bbd04d46782` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.209505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe92cbcbcab4b3db82c9bbd04d46782)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.211406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.212277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda584-ada5-4cbd-950a-844519e20b84 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.217120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.217740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.218015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.218286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] PATH_INFO: `/v3/projects/858a987d990740878a5c1f3f5e496346` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.219431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858a987d990740878a5c1f3f5e496346)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.221380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.276926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858a987d990740878a5c1f3f5e496346', 'request_id': 'req-facf2a7a-797c-4b87-bdbc-e1817de7ee99'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.277329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe92cbcbcab4b3db82c9bbd04d46782', 'request_id': 'req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.285650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe92cbcbcab4b3db82c9bbd04d46782', 'request_id': 'req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.285932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858a987d990740878a5c1f3f5e496346', 'request_id': 'req-facf2a7a-797c-4b87-bdbc-e1817de7ee99'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.294603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe92cbcbcab4b3db82c9bbd04d46782', 'request_id': 'req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.298749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858a987d990740878a5c1f3f5e496346', 'request_id': 'req-facf2a7a-797c-4b87-bdbc-e1817de7ee99'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.313839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] The token cache is being invalidate because project 858a987d990740878a5c1f3f5e496346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:26.314245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.320114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.320114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1014/2029] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/projects/858a987d990740878a5c1f3f5e496346 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.320114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.320114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.324034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] The token cache is being invalidate because project dfe92cbcbcab4b3db82c9bbd04d46782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:26.324787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.325581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.330528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1016/2030] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/projects/dfe92cbcbcab4b3db82c9bbd04d46782 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.331863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.333506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.349924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:26.412315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2a7a-797c-4b87-bdbc-e1817de7ee99 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.417380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.418018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.418298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.418574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] PATH_INFO: `/v3/users/f585ee361b6f4e43a19fb2ede20b1338` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.419909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f585ee361b6f4e43a19fb2ede20b1338)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.421855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.436292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf02cca-cc5c-43df-b8bf-6e3d6fc88600 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.442617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.443356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.443867 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.444244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.444972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.447487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.482807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f585ee361b6f4e43a19fb2ede20b1338'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.486875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1017/2031] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:26 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:26.489017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.492129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.502922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f585ee361b6f4e43a19fb2ede20b1338'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.503871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f585ee361b6f4e43a19fb2ede20b1338'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.515359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f585ee361b6f4e43a19fb2ede20b1338'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.516430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f585ee361b6f4e43a19fb2ede20b1338'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.519460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:26.540838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1015/2032] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/users/f585ee361b6f4e43a19fb2ede20b1338 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.542294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.544181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.600286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a20b6-43ef-41d2-9b99-6c17c53cfe70 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.631411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0b9c-6c2e-45fc-827d-39b8e70cc6ff admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.638193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.639127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.639714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.640130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] PATH_INFO: `/v3/users/a23b51b5f3bc48c1884374280869001b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.641965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23b51b5f3bc48c1884374280869001b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.645275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.715797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23b51b5f3bc48c1884374280869001b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.742105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:26.742759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:26.743040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:26.745014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] PATH_INFO: `/v3/users/019a4b2635b741b282a41a7588d7cfb1` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:26.749255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019a4b2635b741b282a41a7588d7cfb1)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:26.751727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23b51b5f3bc48c1884374280869001b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.753767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23b51b5f3bc48c1884374280869001b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.754579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:26.776289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23b51b5f3bc48c1884374280869001b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.777044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23b51b5f3bc48c1884374280869001b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.793845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1016/2033] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/users/a23b51b5f3bc48c1884374280869001b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.795084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.810420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.848831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:26.851072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019a4b2635b741b282a41a7588d7cfb1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.869837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019a4b2635b741b282a41a7588d7cfb1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.881811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019a4b2635b741b282a41a7588d7cfb1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.883824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019a4b2635b741b282a41a7588d7cfb1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.900885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019a4b2635b741b282a41a7588d7cfb1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:26.915341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1018/2034] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/users/019a4b2635b741b282a41a7588d7cfb1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:26.916763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:26.920243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:26.959044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911583f3-e021-4aff-8b4b-7ee4fb511008 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:26.982886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:27.038439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c4c1d-e0aa-424c-9822-d71aad52f565 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.044441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.045233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.045518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.045797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.046450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.048423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02690db8-56e8-434d-8d78-966651b5e0e2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.070463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.071386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.073885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.076887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] PATH_INFO: `/v3/users/f8c09e26a0e24d05a89dcd30cc296ffc` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.081159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1019/2035] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:26 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:27.083888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c09e26a0e24d05a89dcd30cc296ffc)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.085603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a592-ab07-4983-a526-390f5b60292c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.085915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a592-ab07-4983-a526-390f5b60292c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.086188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a592-ab07-4983-a526-390f5b60292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.087503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.129043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-eab9a592-ab07-4983-a526-390f5b60292c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:27.130301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eab9a592-ab07-4983-a526-390f5b60292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.182287 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1020/2036] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:27.183810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37c1c-1c41-4a34-9cfd-f5e1da91b607 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.184266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37c1c-1c41-4a34-9cfd-f5e1da91b607 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.184519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd37c1c-1c41-4a34-9cfd-f5e1da91b607 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.189489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1021/2037] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:38:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:38:27.190307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd37c1c-1c41-4a34-9cfd-f5e1da91b607 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.214709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd37c1c-1c41-4a34-9cfd-f5e1da91b607 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.217623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c09e26a0e24d05a89dcd30cc296ffc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.223357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.224690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.224690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.224690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.225174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.226900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32773e7-2111-40ef-a3b6-bb17db90a4b9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.245432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c09e26a0e24d05a89dcd30cc296ffc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.246329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c09e26a0e24d05a89dcd30cc296ffc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.257883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1022/2038] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:27.259138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.259420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.259738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.283700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c09e26a0e24d05a89dcd30cc296ffc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.286018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c09e26a0e24d05a89dcd30cc296ffc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.320216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:27.321617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.324682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1017/2039] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:26 2022] DELETE /identity/v3/users/f8c09e26a0e24d05a89dcd30cc296ffc => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:27.333149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.338771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.420829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75ff4-1784-4dfc-b7c9-d9d6b8a04646 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.425926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.426652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.426933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.427893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.432417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.435279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1023/2040] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:27.436744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.439367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.497809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:27.518528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:27.554384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.555844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd017f4-85eb-422d-b87b-154bfee68a18 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.566758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1018/2041] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:27.567907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.568184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.568457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.576945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae617a6-3fad-4bd6-b30f-53ab4e3986fe None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.581555 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.582315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.582931 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.583283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] PATH_INFO: `/v3/projects/85ed63bba86048bc9ec7b6e153ff698b/users/112477d19c94419281f20506101bbc9e/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.589014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:27.592171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.607896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1019/2042] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:27.609001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.611572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.615837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ed63bba86048bc9ec7b6e153ff698b, user_id=112477d19c94419281f20506101bbc9e, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.619056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.630401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5dfc9-f7a3-4f58-876e-a7549efb6a85 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.636488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1024/2043] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:27 2022] PUT /identity/v3/projects/85ed63bba86048bc9ec7b6e153ff698b/users/112477d19c94419281f20506101bbc9e/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:27.637763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.642291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.704666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.705537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.705679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.706100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.717414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.718519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b131f7-baea-4b2c-869a-29c7d2e628b2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.719238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.723991 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.724783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.725061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.725511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] PATH_INFO: `/v3/projects/9c1c9e7151eb48b7a078048370082c91` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.726537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1c9e7151eb48b7a078048370082c91)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.728509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.733414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1020/2044] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:27.734272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.735942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.769122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d4782-fc59-481e-9403-2a7e39b94be4 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:27.775692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:27.777108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:27.777451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:27.777738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] PATH_INFO: `/v3/projects/9798a5d6b5d44c5b8919fe858865c26b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:27.779100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9798a5d6b5d44c5b8919fe858865c26b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:27.798290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1c9e7151eb48b7a078048370082c91', 'request_id': 'req-da0b578e-1465-4515-8e3d-17a4f8744295'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.802257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:27.808948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1c9e7151eb48b7a078048370082c91', 'request_id': 'req-da0b578e-1465-4515-8e3d-17a4f8744295'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.822074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1c9e7151eb48b7a078048370082c91', 'request_id': 'req-da0b578e-1465-4515-8e3d-17a4f8744295'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.843907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] The token cache is being invalidate because project 9c1c9e7151eb48b7a078048370082c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:27.844359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.845196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.847992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1025/2045] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:27 2022] DELETE /identity/v3/projects/9c1c9e7151eb48b7a078048370082c91 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:27.849138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.852532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.870641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9798a5d6b5d44c5b8919fe858865c26b', 'request_id': 'req-c37bb93b-40ce-4c91-b6f2-0a2485932566'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.880040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9798a5d6b5d44c5b8919fe858865c26b', 'request_id': 'req-c37bb93b-40ce-4c91-b6f2-0a2485932566'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.889901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9798a5d6b5d44c5b8919fe858865c26b', 'request_id': 'req-c37bb93b-40ce-4c91-b6f2-0a2485932566'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.905883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] The token cache is being invalidate because project 9798a5d6b5d44c5b8919fe858865c26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:27.906176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.906853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:27.910059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1021/2046] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:27 2022] DELETE /identity/v3/projects/9798a5d6b5d44c5b8919fe858865c26b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:27.911229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:27.914976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:27.930777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:27.957349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b578e-1465-4515-8e3d-17a4f8744295 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.018195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:28.022814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.023882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.023882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.024082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.026199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.051771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bb93b-40ce-4c91-b6f2-0a2485932566 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.059280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.060077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.060685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.061262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.061647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.062423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.064350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9abd4b-355b-482f-8348-ea37109f92b2 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.075040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.078363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1026/2047] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:28.079894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b71de5-0933-4526-a152-7032f1d6a58f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.080288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b71de5-0933-4526-a152-7032f1d6a58f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.080565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b71de5-0933-4526-a152-7032f1d6a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.099869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1022/2048] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:28.103299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.103436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e1b71de5-0933-4526-a152-7032f1d6a58f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:28.104514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.104631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e1b71de5-0933-4526-a152-7032f1d6a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.120257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1027/2049] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:28.120257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.120257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.120257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.131818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea03b8-32fa-4c66-8623-52836f9ec377 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.140289 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.141041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:28.141319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.141611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.141895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] PATH_INFO: `/v3/projects/7ee34cbec3304fa2ac876bfe824fa904` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.142448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.143112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee34cbec3304fa2ac876bfe824fa904)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.146641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.151685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1028/2050] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:28.152495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.162732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71d600-06d8-4b77-84b2-84ab6498b067 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.172676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.173341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.173622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.174174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] PATH_INFO: `/v3/projects/85ed63bba86048bc9ec7b6e153ff698b/users/112477d19c94419281f20506101bbc9e/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.177688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ed63bba86048bc9ec7b6e153ff698b, user_id=112477d19c94419281f20506101bbc9e, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.180712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56da679-7b64-42ad-a933-9305574828eb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.196540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1029/2051] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:28 2022] PUT /identity/v3/projects/85ed63bba86048bc9ec7b6e153ff698b/users/112477d19c94419281f20506101bbc9e/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:28.208559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8272-15d5-4885-b29d-fcb4adbb788c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.208844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8272-15d5-4885-b29d-fcb4adbb788c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.209160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8272-15d5-4885-b29d-fcb4adbb788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.234008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5a9d8272-15d5-4885-b29d-fcb4adbb788c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:28.235365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5a9d8272-15d5-4885-b29d-fcb4adbb788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.256259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee34cbec3304fa2ac876bfe824fa904', 'request_id': 'req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.269873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee34cbec3304fa2ac876bfe824fa904', 'request_id': 'req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.288018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee34cbec3304fa2ac876bfe824fa904', 'request_id': 'req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.321425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] The token cache is being invalidate because project 7ee34cbec3304fa2ac876bfe824fa904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:28.322000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.323239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f6d32ac8-25bd-4e97-ae00-a7ebfc37bf7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.323784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1030/2052] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:28.325872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1023/2053] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:28 2022] DELETE /identity/v3/projects/7ee34cbec3304fa2ac876bfe824fa904 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:28.327688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.328881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.329308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.329420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.329710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.329994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.354857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:28.356273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.367671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1031/2054] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:28.370790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] MFA Rules not processed for user `112477d19c94419281f20506101bbc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:28.372219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.372676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.374046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.389063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593ec4-7745-470d-8a33-bd526441dda7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.395073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.396215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.396215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.396442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.396969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:28.397279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.399920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.418645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1032/2055] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:28.419571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.422307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.445279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d108-a052-4cba-9075-b66516edad28 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.456440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.457097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.457380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.458046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] PATH_INFO: `/v3/users/c747da85f9d74dffa1df79b9ca176e2d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.459209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c747da85f9d74dffa1df79b9ca176e2d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.462137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.479736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1024/2056] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:28.480599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.494457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b31d7-c229-4a67-93bf-9c58f7e83de6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.502545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.503218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.503495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.503796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.504449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:28.504999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.506622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.527633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1025/2057] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:28.527817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.542395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119a9c-3c16-4df9-91ff-4a083f5431e7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.553192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.553986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.554271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.554549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.555944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.559499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.582383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:28.586082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c747da85f9d74dffa1df79b9ca176e2d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.626016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c747da85f9d74dffa1df79b9ca176e2d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.643154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1026/2058] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:28.643710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.645913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.654924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c747da85f9d74dffa1df79b9ca176e2d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.655896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c747da85f9d74dffa1df79b9ca176e2d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.669198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c747da85f9d74dffa1df79b9ca176e2d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:28.677628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:28.684965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1033/2059] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:28 2022] DELETE /identity/v3/users/c747da85f9d74dffa1df79b9ca176e2d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:28.686019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.689272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.739868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233776a-268e-4520-8e8c-ce6b2697d120 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.823082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.824185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.825066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.825429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.828712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.836305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40958f-9a88-45d4-97d2-4157c0e736cb admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:28.853664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:28.854487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:28.854880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:28.855259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:28.856040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.861446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.920939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1034/2060] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:28.924756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:28.925264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.931616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:28.934917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.949454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1027/2061] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:28.951472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:28.953946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:28.983283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd564-795d-47e6-80a2-35223d8aa579 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.058114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66332-9c92-4c45-8406-cf97490167f7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.064090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.064942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.065322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.065731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] PATH_INFO: `/v3/projects/00bb2f8026d54944badde35ef97f616b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.067059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bb2f8026d54944badde35ef97f616b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.069212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.105699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.106327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.106656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.106934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.107922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.110437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.135428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bb2f8026d54944badde35ef97f616b', 'request_id': 'req-f5e182ad-4757-412f-80bf-56ad957c856b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.136972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:29.146291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1028/2062] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:28 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:29.146291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.151623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bb2f8026d54944badde35ef97f616b', 'request_id': 'req-f5e182ad-4757-412f-80bf-56ad957c856b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.165846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bb2f8026d54944badde35ef97f616b', 'request_id': 'req-f5e182ad-4757-412f-80bf-56ad957c856b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.168492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca292a-aadb-43ed-b2c1-1e396f062190 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.180182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:29.181313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] The token cache is being invalidate because project 00bb2f8026d54944badde35ef97f616b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:29.181729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.182442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.184619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1035/2063] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:28 2022] DELETE /identity/v3/projects/00bb2f8026d54944badde35ef97f616b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:29.185506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.186912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.275716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.276343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.276623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.276951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.277593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.279935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.286153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e182ad-4757-412f-80bf-56ad957c856b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.293533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.294387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.295519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.296501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.300657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.310194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1029/2064] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:29 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:29.311058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.313274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.326383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e9d7-e0af-46a4-bcb4-24248f652796 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.331965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.332861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.333143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.333412 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.334052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.335726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.346563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1030/2065] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:29.347430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.349154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.363425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c719-ff66-4ad7-8405-5692d87c4397 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.369174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.369845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.370199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.370478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] PATH_INFO: `/v3/users/978398a05a154034a52dc5150a7f099b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.371700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=978398a05a154034a52dc5150a7f099b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.373681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.385334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.386716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.400420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1036/2066] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:29.401977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.403842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.422504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3ef3-7811-48dc-a3ca-2a92c0baa519 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.428917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.429720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.430003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.430383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] PATH_INFO: `/v3/projects/cb81922381144362a90fee0ee2b8fa9d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.432269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb81922381144362a90fee0ee2b8fa9d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.434264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978398a05a154034a52dc5150a7f099b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.434761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.454528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978398a05a154034a52dc5150a7f099b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.455343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978398a05a154034a52dc5150a7f099b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.468710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978398a05a154034a52dc5150a7f099b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.469990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978398a05a154034a52dc5150a7f099b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.498859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1031/2067] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:29 2022] DELETE /identity/v3/users/978398a05a154034a52dc5150a7f099b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:29.500023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.504113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.504252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb81922381144362a90fee0ee2b8fa9d', 'request_id': 'req-f2418c71-d5c3-42b4-a656-ff2dd274860e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.510729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb81922381144362a90fee0ee2b8fa9d', 'request_id': 'req-f2418c71-d5c3-42b4-a656-ff2dd274860e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.526480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb81922381144362a90fee0ee2b8fa9d', 'request_id': 'req-f2418c71-d5c3-42b4-a656-ff2dd274860e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.560853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] The token cache is being invalidate because project cb81922381144362a90fee0ee2b8fa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:29.561155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.566279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:29.570335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1037/2068] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:29 2022] DELETE /identity/v3/projects/cb81922381144362a90fee0ee2b8fa9d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:29.573779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.578548 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.623525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:29.723314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1942c-b780-4bc5-bf9e-e8b9728180aa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.749221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.755155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.755319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.756337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.756915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2418c71-d5c3-42b4-a656-ff2dd274860e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.758152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.761686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87674a54-dbaa-441d-9075-e17ffc7dbd07 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.769635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.770278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.770589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.774457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.775327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.777096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:29.778736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.795654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1032/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:29.797268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504c48-e870-41c1-96b7-389372827175 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.797560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504c48-e870-41c1-96b7-389372827175 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.797936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504c48-e870-41c1-96b7-389372827175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.816429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1038/2070] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:29.816429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.821964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.866371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-84504c48-e870-41c1-96b7-389372827175 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:29.868307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-84504c48-e870-41c1-96b7-389372827175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:29.869232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae7ec3-788f-48b5-90d0-c84587449851 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.882247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.882872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.883154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.883477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.886877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.892245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1033/2071] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:29.894467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504c48-e870-41c1-96b7-389372827175 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:29.894921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c2bf8-a676-49e8-8b02-e39aaca780f0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.914169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504c48-e870-41c1-96b7-389372827175 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:29.925546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1039/2072] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:29.928043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d636-e5a9-44eb-8304-83ae3864e43c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.928326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d636-e5a9-44eb-8304-83ae3864e43c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.929295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d636-e5a9-44eb-8304-83ae3864e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.935285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:29.936050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:29.936648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:29.936934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] PATH_INFO: `/v3/projects/a30d9fac496847cabd82a65c805f0c2c/users/1fb687ba934c49ecb071580b06d60d1e/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:29.977596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30d9fac496847cabd82a65c805f0c2c, user_id=1fb687ba934c49ecb071580b06d60d1e, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:29.982070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:29.984175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6899d636-e5a9-44eb-8304-83ae3864e43c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:29.989603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6899d636-e5a9-44eb-8304-83ae3864e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.006491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1034/2073] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:29 2022] PUT /identity/v3/projects/a30d9fac496847cabd82a65c805f0c2c/users/1fb687ba934c49ecb071580b06d60d1e/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:30.007711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.020312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1040/2074] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:30.022820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.023280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.023983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.072056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:30.073729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.120217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a38e8-cc8c-4b29-97b6-67a4e421b958 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.125272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.125951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.126611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.126897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] PATH_INFO: `/v3/projects/54daaad2d8ac415493295ca46d482441/users/48550a8edc5943a3a8b9f59af769e464/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.151247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54daaad2d8ac415493295ca46d482441, user_id=48550a8edc5943a3a8b9f59af769e464, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.154327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793e73-c199-4e41-b4e2-b7ada1ddcf47 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.175825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1041/2075] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:30.176956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.186912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1035/2076] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:30 2022] PUT /identity/v3/projects/54daaad2d8ac415493295ca46d482441/users/48550a8edc5943a3a8b9f59af769e464/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:30.191045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213884d0-459d-47f4-a034-81648e25c868 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.191702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213884d0-459d-47f4-a034-81648e25c868 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.191995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213884d0-459d-47f4-a034-81648e25c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.193216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd917c5e-0588-4b5f-9b7b-4e28f95a2352 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.229851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-213884d0-459d-47f4-a034-81648e25c868 None None] MFA Rules not processed for user `48550a8edc5943a3a8b9f59af769e464`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:30.231109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-213884d0-459d-47f4-a034-81648e25c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.260037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.260656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.261025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.261580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.262208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:30.262517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.264157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.282574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1042/2077] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:30.283503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.286300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.354687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:30.363654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1036/2078] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:30.364606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213884d0-459d-47f4-a034-81648e25c868 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.375314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213884d0-459d-47f4-a034-81648e25c868 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.382068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.382926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.383277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.383571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.384436 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.386549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.388349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966bf8-5359-4419-8e5b-d08f9aa15d91 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.392386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.392993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.393270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.393543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.402841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.404306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.414469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1043/2079] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:30.415264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.416632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1037/2080] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:30.417601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.419622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.433706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d498-4d12-4024-90c7-cfcd2d8a9b3d service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.451196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:30.498753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a491d-b73c-4378-ba88-821a6b4aa82b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.499011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.499832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.500204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.500645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] PATH_INFO: `/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.501883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffcf7f970cd45329234e4c2d3c9fbe5)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.504754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.505386 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.505692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.505820 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.505929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.506534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.508674 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.540167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1038/2081] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:30.541154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.565523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffcf7f970cd45329234e4c2d3c9fbe5', 'request_id': 'req-0007e536-fc05-482c-9c39-7563614a1ffc'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:30.574356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffcf7f970cd45329234e4c2d3c9fbe5', 'request_id': 'req-0007e536-fc05-482c-9c39-7563614a1ffc'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:30.586560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffcf7f970cd45329234e4c2d3c9fbe5', 'request_id': 'req-0007e536-fc05-482c-9c39-7563614a1ffc'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:30.608829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] The token cache is being invalidate because project 0ffcf7f970cd45329234e4c2d3c9fbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:30.608829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:30.608829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:30.608829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1044/2082] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:30 2022] DELETE /identity/v3/projects/0ffcf7f970cd45329234e4c2d3c9fbe5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:30.608829 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.611360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.666146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f33cd-131d-46ab-9a1b-166e722d9fb9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.701807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e536-fc05-482c-9c39-7563614a1ffc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.708647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.709626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.710102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.710777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.711630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.713944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5321d3-5269-4601-84ea-d1ba4ca4a097 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.725180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:30.746415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.747181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.747512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.748102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.748745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.750889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.773308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1045/2083] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:30.775557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.775930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.776371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.785704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1039/2084] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:30.790919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.805203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e20a53-b3f7-4a88-9335-012b14bbaa3f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.805661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:30.807589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.819008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.819764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.820010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.820370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.820925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.822639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bd761-c5bf-4906-8a97-7be17646ffb9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.826907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1046/2085] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:30.827416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.828742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.846590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1040/2086] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:30.848437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.848721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.848991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.855871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefb64e-83c4-452d-9753-a1dfc44b1cf7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.861320 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.862089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.862955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.863401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.864127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.867492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.885164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1047/2087] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:30.885164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.891136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:30.892409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:30.894097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cecc-fcb5-42a3-803b-1787bab0e121 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.907145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1041/2088] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:30.908380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.921435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.921870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.922146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.922523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.923251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.924306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbe0ad-7ae4-4a31-b31a-89e3246a795c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.925734 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.932642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.933668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.933958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.934281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.935607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.937657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:30.951225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1048/2089] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:30.951225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.951534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1042/2090] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:30.952547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:30.967215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a29b9-2ee0-4772-bb3a-55477cef7433 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.978435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.979348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.979808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.984474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] PATH_INFO: `/v3/projects/635459a412174c8c9defff47ba7b69de/users/37d2112a887e4d07aeef2b0db92710a2/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.988102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282ec1-0973-40d8-bc67-de69a5ffee9c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:30.994773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:30.995390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:30.995699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:30.995970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:30.996622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:30.996923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:30.998376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:30.998509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.003925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=635459a412174c8c9defff47ba7b69de, user_id=37d2112a887e4d07aeef2b0db92710a2, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.007776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.013079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1049/2091] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:31.013884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.029004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98342a1c-c75c-4adf-9cab-d5597cb6f551 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.034769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1043/2092] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:30 2022] PUT /identity/v3/projects/635459a412174c8c9defff47ba7b69de/users/37d2112a887e4d07aeef2b0db92710a2/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:31.036064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.141833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8fbad-33eb-41a9-a383-8904d514a3ad admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.149298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.150177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.150591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.151035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.152008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.155080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e37e4-b772-4695-9d9d-f115ead5bf83 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.166933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.167853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.168286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.169044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] PATH_INFO: `/v3/projects/386bdd51c7e143029ceb83779cd9dd72/users/77b1ade6b8394f6184d78150ef53643d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.196915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386bdd51c7e143029ceb83779cd9dd72, user_id=77b1ade6b8394f6184d78150ef53643d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.200792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.220488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1044/2093] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:31.222696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451d69-5aaf-469e-b4cb-7393927e88a7 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.222925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451d69-5aaf-469e-b4cb-7393927e88a7 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.223332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451d69-5aaf-469e-b4cb-7393927e88a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.238237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1050/2094] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:31 2022] PUT /identity/v3/projects/386bdd51c7e143029ceb83779cd9dd72/users/77b1ade6b8394f6184d78150ef53643d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:31.240374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.274286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f6451d69-5aaf-469e-b4cb-7393927e88a7 None None] MFA Rules not processed for user `37d2112a887e4d07aeef2b0db92710a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:31.275905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f6451d69-5aaf-469e-b4cb-7393927e88a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:31.350632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920fbd6-9bc1-4de6-8388-133a59cccb56 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.377546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.380041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.380452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.380745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.381382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.383600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95cc2d-c87a-4783-b096-fbf3be3f573a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.439648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1051/2095] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:31.447843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.449747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.450175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.476742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1045/2096] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:31.478364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.478798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.479219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.539902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] MFA Rules not processed for user `77b1ade6b8394f6184d78150ef53643d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:31.543347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:31.546767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] MFA Rules not processed for user `1fb687ba934c49ecb071580b06d60d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:31.548066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:31.567387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:31.694778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1052/2097] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:31.697264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.717898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:31.730035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba4dd-b108-4d67-b18e-d2be6d0cfef3 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.748558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1046/2098] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:31.749263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.752752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.758576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.762361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.763499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.765492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.771302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.776085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90580d9-2f0c-49e6-99d7-68da1fd6ff07 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.800372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.801021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.801281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.801680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.802309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.803608 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1053/2099] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:31.804874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.805816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.820170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fe675-f2e2-4670-87a7-3b0c0a8e36bc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:31.827616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:31.828424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:31.828844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:31.829365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:31.830598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:31.835374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:31.850776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1047/2100] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:31.850776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.853592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:31.895014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1054/2101] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:31.896451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:31.944573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e702-5e3d-4545-bca8-6db23b641cd6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.025993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c9b-0531-4570-a6ce-54c5b4dc915d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.039985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.040620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.042905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.043188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.043896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.048150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.075862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1055/2102] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.076752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.087231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c36d6-d61a-43d7-b8b4-7e69919249b5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.093023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.093660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.093942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.094216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.094876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.096847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.098382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.099228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.099701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.100118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.100896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.103279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.120655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1056/2103] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:32 2022] POST /identity/v3/users => generated 299 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:32.121530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.133586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e990-507b-48b3-a279-5a0498707105 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.136964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1048/2104] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:32.137617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.141518 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.142215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.142567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.142915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.144692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.146754 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.171493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1057/2105] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:32 2022] POST /identity/v3/users => generated 306 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:32.172104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.189864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63092-aed6-49e5-bec5-208e2b816f93 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.212303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb44425-dbab-447a-9f88-984e1ac93432 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.218526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.219195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.219654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.219993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] PATH_INFO: `/v3/projects/bdedf1cf88384d87ba30734e15a58794/users/a25f25f08e904499949193cc17387286/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.232004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:32.237072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:32.244138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdedf1cf88384d87ba30734e15a58794, user_id=a25f25f08e904499949193cc17387286, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.247415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.267418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.268405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.268814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.269187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.269937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.271731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.275573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1049/2106] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:32 2022] PUT /identity/v3/projects/bdedf1cf88384d87ba30734e15a58794/users/a25f25f08e904499949193cc17387286/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:32.276843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.302174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1058/2107] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.302929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.315594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e2bf-f33e-4f56-925e-88da2f89ae0a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.383503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008f51-577b-4bc1-81c6-fed8f123bc00 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.398139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.398500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.399440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.399780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.400052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.400242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.400512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.401294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.402252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.402447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.405200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.405928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad561c04-4869-483b-bf17-6776b9007a5f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.436429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1059/2108] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.436429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.436429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.438335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.469890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1050/2109] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:32 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:32.469890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.481067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1aa37-2256-455f-ba24-0c088c97759e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.483286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] MFA Rules not processed for user `a25f25f08e904499949193cc17387286`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:32.484735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:32.487261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.488801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.489266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.489712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] PATH_INFO: `/v3/projects/b246231aefa649c89cc1b31db8a4964a/users/919ec059e6024ecd9015efe209d7bad1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.510028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b246231aefa649c89cc1b31db8a4964a, user_id=919ec059e6024ecd9015efe209d7bad1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.514472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.541797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1051/2110] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:32 2022] PUT /identity/v3/projects/b246231aefa649c89cc1b31db8a4964a/users/919ec059e6024ecd9015efe209d7bad1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:32.541797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.600706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1060/2111] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:32.611590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.632171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed86c8-505d-4bf6-b1eb-4d7bebed8e2a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.664754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54049b-1243-4a0b-8aa5-2748c5328d48 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.670840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.672291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.672738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.673184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] PATH_INFO: `/v3/projects/70881074bffa422bb506f2e1baf0e3c3/users/c96c3068eddb42139aed759bfafd4ad1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.716581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70881074bffa422bb506f2e1baf0e3c3, user_id=c96c3068eddb42139aed759bfafd4ad1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.723083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.724274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.725247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.725544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.725817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.726477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.728869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.733631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:32.745288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1052/2112] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:32 2022] PUT /identity/v3/projects/70881074bffa422bb506f2e1baf0e3c3/users/c96c3068eddb42139aed759bfafd4ad1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:32.746231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1061/2113] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.747395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.747508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.752709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:32.807150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:32.842069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c1d4-aeb6-4c55-a448-cd86afd07a6f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.844341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423655-3969-441a-90a1-b88bf5dcdb2f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.850186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.850843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.851062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.851334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.852104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.854493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.870905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1053/2114] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.870905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.882327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5abf-33b4-44c5-b3fc-c5a63b07ed96 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.889087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.889699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.889977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.890253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.890939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.896825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.907627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1054/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:32.911580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.919520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.920164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.920440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.920700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.922640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530498-922a-44aa-85ec-b4242082f2fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:32.928924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:32.929568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:32.929848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:32.930115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] PATH_INFO: `/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f/users/9a33baeb65a3474e816c05f2396c171f/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:32.945739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e17e05a1fd4c5f9ebee6950623d77f, user_id=9a33baeb65a3474e816c05f2396c171f, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.948703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:32.964664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1055/2116] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:32 2022] PUT /identity/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f/users/9a33baeb65a3474e816c05f2396c171f/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:32.965460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:32.991683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:32.993171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.003766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1062/2117] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:33.004763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.015350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77d65-c760-4466-89f6-68ff84c02632 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.065012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7526-1a90-458a-8f21-e0573ec23283 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.071490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.071490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.071490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.071490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] PATH_INFO: `/v3/projects/b246231aefa649c89cc1b31db8a4964a/users/919ec059e6024ecd9015efe209d7bad1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.078902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b246231aefa649c89cc1b31db8a4964a, user_id=919ec059e6024ecd9015efe209d7bad1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.081070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.081775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.082056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.082323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] PATH_INFO: `/v3/projects/70881074bffa422bb506f2e1baf0e3c3/users/c96c3068eddb42139aed759bfafd4ad1/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.084533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70881074bffa422bb506f2e1baf0e3c3, user_id=c96c3068eddb42139aed759bfafd4ad1, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.086251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ff2e4-ff43-482d-a194-d1eac2b3edb5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.088012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.102557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1063/2118] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:33 2022] PUT /identity/v3/projects/70881074bffa422bb506f2e1baf0e3c3/users/c96c3068eddb42139aed759bfafd4ad1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:33.103396 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.103971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1056/2119] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:32 2022] PUT /identity/v3/projects/b246231aefa649c89cc1b31db8a4964a/users/919ec059e6024ecd9015efe209d7bad1/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:33.113374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31275a2-f9c5-473d-be9a-8181e0a4e86a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.113694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31275a2-f9c5-473d-be9a-8181e0a4e86a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.114067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31275a2-f9c5-473d-be9a-8181e0a4e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.120859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:33.163273 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f31275a2-f9c5-473d-be9a-8181e0a4e86a None None] MFA Rules not processed for user `c96c3068eddb42139aed759bfafd4ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:33.164901 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f31275a2-f9c5-473d-be9a-8181e0a4e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:33.206746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47576c8e-1a60-403f-9fa9-ac5f5d2d91e1 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.251991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1057/2120] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:33.253873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.254549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.255512 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.281429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.282042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.282352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.282641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.283404 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.285534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.298680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] MFA Rules not processed for user `919ec059e6024ecd9015efe209d7bad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:33.299800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1064/2121] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:33.300494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:33.301099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.305263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:33.307425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:33.406464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1058/2122] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:33.406464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.416259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3bb17-8cf9-4885-b731-c7e4f0c71325 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.422187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e96a17-6115-4220-9674-9a2b7e702e42 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.422335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.423179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.423486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.423912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] PATH_INFO: `/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f/users/9a33baeb65a3474e816c05f2396c171f/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.429148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.430051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.430523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.430974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.436344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e17e05a1fd4c5f9ebee6950623d77f, user_id=9a33baeb65a3474e816c05f2396c171f, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.439119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.445896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.447708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.453673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1059/2123] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:33 2022] PUT /identity/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f/users/9a33baeb65a3474e816c05f2396c171f/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:33.458970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1065/2124] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:33.499813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.567026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a81e6-e423-4a9f-ab5c-c14f5c393e09 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.570933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.571648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.571921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.572358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.619670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.621621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:33.654088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01ffe-1704-42fc-a178-9e2c7269794c service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.657768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.659234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.679893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1060/2125] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:33.692016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:33.707364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f85c1f-7967-4017-997d-480f5b42f038 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:33.713170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.714097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.714376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.714646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.760622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:33.785634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:33.786464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.786651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.786887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] PATH_INFO: `/v3/users/a647853e962c4ed7b65fea5a4e66ba1c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:33.789072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a647853e962c4ed7b65fea5a4e66ba1c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.791134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.802510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:33.841446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:33.845781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4d287-ff42-42b4-84f9-8284a6102866 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:33.865946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1061/2126] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:33.872847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a647853e962c4ed7b65fea5a4e66ba1c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:33.917223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a647853e962c4ed7b65fea5a4e66ba1c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:33.938556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a647853e962c4ed7b65fea5a4e66ba1c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:33.939411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a647853e962c4ed7b65fea5a4e66ba1c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:33.948236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a647853e962c4ed7b65fea5a4e66ba1c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:33.975987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1066/2127] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:33 2022] DELETE /identity/v3/users/a647853e962c4ed7b65fea5a4e66ba1c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:33.980423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6891-159c-459a-8b3b-fd669fde4c6f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:33.980842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6891-159c-459a-8b3b-fd669fde4c6f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:33.981266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6891-159c-459a-8b3b-fd669fde4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.031558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8a9b6891-159c-459a-8b3b-fd669fde4c6f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:34.033137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8a9b6891-159c-459a-8b3b-fd669fde4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.222378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1062/2128] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:34.235759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:34.239136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.362009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:34.362338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:34.362613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.390379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c90be-8886-46c5-b19a-972a1529f4e8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:34.395139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:34.401978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:34.402500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:34.402874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.419881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:34.422087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:34.434035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1067/2129] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:34.451665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] MFA Rules not processed for user `9a33baeb65a3474e816c05f2396c171f`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:34.452871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.629188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1063/2130] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:34.645728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:34.647535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.727774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044c91-c31b-4bd9-becf-591662036438 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:34.731513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:34.732152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:34.732429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:34.732702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.734969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.762106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:34.787447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:34.789522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.803810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9daf3-f237-40d8-a8eb-a290ec46aa57 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:34.808158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:34.809199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:34.809441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:34.809587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:34.809966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.811286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:34.812042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.822650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1068/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:34.915035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:34.916788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:34.923187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:34.927416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:34.934603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:34.944056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952084-98cb-4833-a65d-c98567024f90 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:34.945299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1064/2132] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:34.950225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:34.950956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:34.951234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:34.951573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] PATH_INFO: `/v3/projects/ed70962529784a9695eab979a06cdf8b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:34.952908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed70962529784a9695eab979a06cdf8b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:34.955319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:35.032877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed70962529784a9695eab979a06cdf8b', 'request_id': 'req-3eb59dbf-63a9-41cb-a332-36458b6da414'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.041748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed70962529784a9695eab979a06cdf8b', 'request_id': 'req-3eb59dbf-63a9-41cb-a332-36458b6da414'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.051768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed70962529784a9695eab979a06cdf8b', 'request_id': 'req-3eb59dbf-63a9-41cb-a332-36458b6da414'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.067002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] The token cache is being invalidate because project ed70962529784a9695eab979a06cdf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:35.067324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.068072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.070877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1069/2133] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:34 2022] DELETE /identity/v3/projects/ed70962529784a9695eab979a06cdf8b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:35.075383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:35.089338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aec08-3172-4845-a200-ffe777113576 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:35.155283 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:35.156054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:35.156404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:35.156705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] PATH_INFO: `/v3/users/112477d19c94419281f20506101bbc9e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:35.157994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112477d19c94419281f20506101bbc9e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:35.160322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:35.218919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112477d19c94419281f20506101bbc9e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.240281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112477d19c94419281f20506101bbc9e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.241206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112477d19c94419281f20506101bbc9e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.262519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112477d19c94419281f20506101bbc9e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.263217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4116cf09-bef5-47dd-8551-4f1d2cf5fcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112477d19c94419281f20506101bbc9e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.278828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1065/2134] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:35 2022] DELETE /identity/v3/users/112477d19c94419281f20506101bbc9e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:35.790550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:35.793834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:35.826444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb59dbf-63a9-41cb-a332-36458b6da414 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:35.898627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:35.899374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:35.899705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:35.899979 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] PATH_INFO: `/v3/projects/85ed63bba86048bc9ec7b6e153ff698b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:35.901138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ed63bba86048bc9ec7b6e153ff698b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:35.903089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:35.954886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ed63bba86048bc9ec7b6e153ff698b', 'request_id': 'req-b8a42a8d-2980-495d-9c80-438547352f09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.956704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:35.963944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ed63bba86048bc9ec7b6e153ff698b', 'request_id': 'req-b8a42a8d-2980-495d-9c80-438547352f09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.972911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ed63bba86048bc9ec7b6e153ff698b', 'request_id': 'req-b8a42a8d-2980-495d-9c80-438547352f09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.984912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] The token cache is being invalidate because project 85ed63bba86048bc9ec7b6e153ff698b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:35.985198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.986011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b8a42a8d-2980-495d-9c80-438547352f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:35.987573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1070/2135] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:35 2022] DELETE /identity/v3/projects/85ed63bba86048bc9ec7b6e153ff698b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:35.992751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:35.993272 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:35.993433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.014438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:36.015842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:36.077737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1066/2136] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:36.086534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.086850 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.087296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.107641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:36.109031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:36.121952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1071/2137] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:36.126185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.136849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557233-505b-4162-a9cb-e9831f26990e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.141692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.142293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.142571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.142867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.144122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:36.144423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.146002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.157954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1067/2138] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:38:36.162163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.171872 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7b58b-6e3d-4319-be77-45b364793855 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.179652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.180265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.180547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.180819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.181454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.183374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.213595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1072/2139] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:36.217707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.227880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21110-9933-4d0e-94db-1d9582f6755e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.231529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:36.292566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.293174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.293453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.293726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.294355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.296313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.319603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1068/2140] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:36.323631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.335157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c9d2-5254-4631-98d8-82b7b18d1721 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.341678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.342366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.342834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.343087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.343841 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.345528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.372162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1073/2141] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:36.373378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.384356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a255b-380d-47d9-8d49-8a8f34dace9e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.389148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.389753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.390030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.390300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.390944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.392606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e436-6637-4c75-93dc-0e95fe7636fb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.407187 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1069/2142] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:36.409373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.419987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efcdf-4423-4526-85ae-d0d616bfad99 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.425110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.425920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.426304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.426578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] PATH_INFO: `/v3/projects/8807bb5ed07a4ff48aace5b7d2f7d41a/users/86bf4f4a924b47d4b9527ba237cbaa09/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.442229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8807bb5ed07a4ff48aace5b7d2f7d41a, user_id=86bf4f4a924b47d4b9527ba237cbaa09, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.444885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.459343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1074/2143] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:36 2022] PUT /identity/v3/projects/8807bb5ed07a4ff48aace5b7d2f7d41a/users/86bf4f4a924b47d4b9527ba237cbaa09/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:36.470680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.470962 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.471231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.498888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] MFA Rules not processed for user `86bf4f4a924b47d4b9527ba237cbaa09`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:36.500134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:36.574837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1070/2144] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:36.576390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.645481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcde93-84d0-4d35-88bc-5d617d7ee70f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.650072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.650668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.650941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.651207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.651852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.653731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.684831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1075/2145] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:36.685971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.697575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8341f-98cd-4baf-94c4-4fab6535b38a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.755655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.756558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.756841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.757112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.757742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.759671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.783410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1071/2146] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:36 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:36.785273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.795737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02ac7-f71d-47a6-b2cf-2516168e5d44 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.801043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.801638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.801914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.802211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.802858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.804476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.815128 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1076/2147] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:36.819362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.826140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:36.829772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a31dee-936c-4e07-b12d-c91c806a3a86 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.836500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.837097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.837376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.837651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] PATH_INFO: `/v3/projects/e5cc74e071144c61956505e2ca98301e/users/73f76af7e413488f99a89062f731153e/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.853526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cc74e071144c61956505e2ca98301e, user_id=73f76af7e413488f99a89062f731153e, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.856235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.872000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1072/2148] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:36 2022] PUT /identity/v3/projects/e5cc74e071144c61956505e2ca98301e/users/73f76af7e413488f99a89062f731153e/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:36.875964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.886093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83d4f-604a-4d5e-826f-de8049f0ec56 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.934499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:36.949112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.949721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.949999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.950267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.950908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.952538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8a6d-82c6-4662-a846-7f435f77e3d8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:36.963238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1077/2149] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:36.967523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:36.978601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874c76d-893f-40ce-8a7b-a54a615b404f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:36.983229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:36.983918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:36.984191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:36.984482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] PATH_INFO: `/v3/projects/e5cc74e071144c61956505e2ca98301e/users/73f76af7e413488f99a89062f731153e/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:36.986342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cc74e071144c61956505e2ca98301e, user_id=73f76af7e413488f99a89062f731153e, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:36.989571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:37.000052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1073/2150] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:36 2022] PUT /identity/v3/projects/e5cc74e071144c61956505e2ca98301e/users/73f76af7e413488f99a89062f731153e/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:37.010017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:37.010307 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:37.010577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:37.038375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] MFA Rules not processed for user `73f76af7e413488f99a89062f731153e`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:37.039617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:37.120839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1078/2151] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:37.136493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:37.139823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:37.226266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce69-08e9-4f7b-9f02-d19c4d9dac0f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:37.231016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:37.231844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:37.232808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:37.232808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:37.243646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:37.244971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:37.255220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1074/2152] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:37.363163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:37.364612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:37.376532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5535c6a-3b8a-490b-8a84-e1ff236a2431 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:37.380433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:37.382383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:37.382668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:37.382941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:37.447455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:37.449016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:37.460136 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1079/2153] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:38.628870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:38.638136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1fb3d-26f0-4848-b465-b982af249c06 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:38.641735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:38.642411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:38.642713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:38.643152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:38.645596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:38.716293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:38.717744 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5193d6-44d1-4b42-9851-927aac06ec75 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:38.728303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1075/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:43.569233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:43.682486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206accb-aca0-41a3-83cc-b82df5c305b1 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:43.688534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:43.689299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:43.689711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:43.690632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] PATH_INFO: `/v3/users/86bf4f4a924b47d4b9527ba237cbaa09` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:43.692007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bf4f4a924b47d4b9527ba237cbaa09)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:43.694105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:43.707344 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:43.751892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bf4f4a924b47d4b9527ba237cbaa09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.764416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bf4f4a924b47d4b9527ba237cbaa09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.773395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bf4f4a924b47d4b9527ba237cbaa09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.774139 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bf4f4a924b47d4b9527ba237cbaa09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.781566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bf4f4a924b47d4b9527ba237cbaa09'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.787946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1080/2155] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:43 2022] DELETE /identity/v3/users/86bf4f4a924b47d4b9527ba237cbaa09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:43.792497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:43.792964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:43.793048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:43.801637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:43.803033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:43.812811 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:43.814163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:43.869107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9f8af-193d-44fc-b960-f0c3cdc5238d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:43.873917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:43.874543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:43.874816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:43.875087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] PATH_INFO: `/v3/users/77b1ade6b8394f6184d78150ef53643d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:43.879038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b1ade6b8394f6184d78150ef53643d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:43.882309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1076/2156] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:43.882470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:43.892771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:43.894264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:43.901251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:43.943563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b1ade6b8394f6184d78150ef53643d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.955178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d2327-5557-4ef9-82f2-0f89bfed7caa None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:43.955647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b1ade6b8394f6184d78150ef53643d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.959282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:43.960077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:43.960363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:43.960617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:43.964424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b1ade6b8394f6184d78150ef53643d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.965085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b1ade6b8394f6184d78150ef53643d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.969887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:43.971360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:43.972222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84ba65eb-b557-40ba-9087-8146f9ea942e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b1ade6b8394f6184d78150ef53643d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:43.977998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1081/2157] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:43 2022] DELETE /identity/v3/users/77b1ade6b8394f6184d78150ef53643d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:43.980814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1077/2158] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:43.982461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:43.983055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:43.983470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:43.998305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:44.006176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:44.007443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:44.089400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1082/2159] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:44.095413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:44.096995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:44.110418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b605-7f50-47f7-bb15-adc285134528 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:44.195113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:44.196073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:44.196352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:44.196685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:44.208671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:44.210121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:44.222793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1078/2160] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:44.465448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:44.466975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:44.480602 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fefe4-f950-4580-8584-1c6b7d5a1ca9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:44.485428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:44.486067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:44.486402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:44.487402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] PATH_INFO: `/v3/projects/8807bb5ed07a4ff48aace5b7d2f7d41a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:44.488720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8807bb5ed07a4ff48aace5b7d2f7d41a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:44.490755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:44.541114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8807bb5ed07a4ff48aace5b7d2f7d41a', 'request_id': 'req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.555385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8807bb5ed07a4ff48aace5b7d2f7d41a', 'request_id': 'req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.563647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8807bb5ed07a4ff48aace5b7d2f7d41a', 'request_id': 'req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.578248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] The token cache is being invalidate because project 8807bb5ed07a4ff48aace5b7d2f7d41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:44.578828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.579679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.581974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1083/2161] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:44 2022] DELETE /identity/v3/projects/8807bb5ed07a4ff48aace5b7d2f7d41a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:44.586229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:44.609082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047810d0-acfb-4637-919e-eb0660eeb9e3 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:44.668668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:44.669491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:44.670200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:44.670200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] PATH_INFO: `/v3/users/73f76af7e413488f99a89062f731153e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:44.671345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f76af7e413488f99a89062f731153e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:44.673383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:44.728444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f76af7e413488f99a89062f731153e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.739568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:44.739568 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:44.740062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:44.760436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a56cb-ac6e-434a-8bcb-1463d8bbc1e0 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:44.764414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f76af7e413488f99a89062f731153e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.765341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f76af7e413488f99a89062f731153e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.767713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:44.768906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:44.769252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:44.769451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] PATH_INFO: `/v3/projects/386bdd51c7e143029ceb83779cd9dd72` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:44.771840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386bdd51c7e143029ceb83779cd9dd72)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:44.776818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f76af7e413488f99a89062f731153e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.777765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f76af7e413488f99a89062f731153e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.777919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:44.797291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1079/2162] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:44 2022] DELETE /identity/v3/users/73f76af7e413488f99a89062f731153e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:44.840749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386bdd51c7e143029ceb83779cd9dd72', 'request_id': 'req-e471e1a7-3a89-4560-9543-b3997166b5e4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.848629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386bdd51c7e143029ceb83779cd9dd72', 'request_id': 'req-e471e1a7-3a89-4560-9543-b3997166b5e4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.856806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386bdd51c7e143029ceb83779cd9dd72', 'request_id': 'req-e471e1a7-3a89-4560-9543-b3997166b5e4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.872885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] The token cache is being invalidate because project 386bdd51c7e143029ceb83779cd9dd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:44.873267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.874116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:44.876351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1084/2163] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:44 2022] DELETE /identity/v3/projects/386bdd51c7e143029ceb83779cd9dd72 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:44.880121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:44.882275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:44.975574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf75960-7e26-48b2-8f0e-522996606c86 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.061009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.061549 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.061828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.062098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] PATH_INFO: `/v3/users/c96c3068eddb42139aed759bfafd4ad1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.064195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96c3068eddb42139aed759bfafd4ad1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.066668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.117161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.118661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.127189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96c3068eddb42139aed759bfafd4ad1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.134036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e1a7-3a89-4560-9543-b3997166b5e4 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.138975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.139658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.139985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.140268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] PATH_INFO: `/v3/projects/e5cc74e071144c61956505e2ca98301e` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.141473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cc74e071144c61956505e2ca98301e)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.143460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.154942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:45.157466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96c3068eddb42139aed759bfafd4ad1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.159791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96c3068eddb42139aed759bfafd4ad1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.170022 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96c3068eddb42139aed759bfafd4ad1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.171331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-69dd4557-cec4-41d9-ab79-9b73d9c8a389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96c3068eddb42139aed759bfafd4ad1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.178266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:45.196205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1080/2164] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:44 2022] DELETE /identity/v3/users/c96c3068eddb42139aed759bfafd4ad1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:45.218833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cc74e071144c61956505e2ca98301e', 'request_id': 'req-d337909c-f036-453e-92b9-00568e3b93c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.226192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cc74e071144c61956505e2ca98301e', 'request_id': 'req-d337909c-f036-453e-92b9-00568e3b93c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.235081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cc74e071144c61956505e2ca98301e', 'request_id': 'req-d337909c-f036-453e-92b9-00568e3b93c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.252566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] The token cache is being invalidate because project e5cc74e071144c61956505e2ca98301e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:45.253458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.254522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d337909c-f036-453e-92b9-00568e3b93c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.256747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1085/2165] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:45 2022] DELETE /identity/v3/projects/e5cc74e071144c61956505e2ca98301e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:45.262194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.262510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.262758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.292240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:45.293573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.385360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1081/2166] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:45.394581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.395124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.395282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.444190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:45.445590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.467587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1086/2167] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:45.469310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.485380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767c21-e8d6-4b84-a9e6-a11614756c73 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.490919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.491719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.492001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.492275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.493343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:45.493653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.495433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.509791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1082/2168] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:45.523207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.532962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a78c-eaff-422a-acb1-0b0c8d7465a8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.538968 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.539598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.539885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.540156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.540785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.542724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.569973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.572102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.615883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1087/2169] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:45.618204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.621597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924d-b96b-4b42-9ad2-f21715d4b016 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.724536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.725429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.725718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.726004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] PATH_INFO: `/v3/projects/70881074bffa422bb506f2e1baf0e3c3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.727365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=70881074bffa422bb506f2e1baf0e3c3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.730259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.749612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c3e3-3b21-4cb4-8cd1-bb828f72fa04 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.758683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.759678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.760245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.760859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.762945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.767313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.800045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70881074bffa422bb506f2e1baf0e3c3', 'request_id': 'req-052d9cbd-ad51-42c0-b9fe-b694816908dc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.802377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1088/2170] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:45 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:45.803847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.807806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.811808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70881074bffa422bb506f2e1baf0e3c3', 'request_id': 'req-052d9cbd-ad51-42c0-b9fe-b694816908dc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.822851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70881074bffa422bb506f2e1baf0e3c3', 'request_id': 'req-052d9cbd-ad51-42c0-b9fe-b694816908dc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.836738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] The token cache is being invalidate because project 70881074bffa422bb506f2e1baf0e3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:45.837029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.837726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:45.839509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1083/2171] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:45 2022] DELETE /identity/v3/projects/70881074bffa422bb506f2e1baf0e3c3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:45.840492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:45.842814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.872410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:45.884699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc621d-e1cc-4a3d-9818-d7bbcb7c46b9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.907234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:45.939365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9cbd-ad51-42c0-b9fe-b694816908dc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:45.944862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.945729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.946237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.946772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.947647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:45.949479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2b471-92fe-4935-887e-2d26bcb87566 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:45.964058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1084/2172] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:45.965221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:45.965844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.966547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.966547 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.967077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:45.967609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:45.968076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:45.968941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:45.994188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:45.995447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.004649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1085/2173] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:46.005452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.015236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad6cf-56d6-4070-9b53-8e5be8350d49 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.025371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.026024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.026305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.026585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.027233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.028939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300a545-bae9-4834-913d-773195ce1af7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.042992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1086/2174] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:46.042992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.042992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.042992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.062222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:46.063487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.063625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.065031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.074459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1089/2175] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:46.075324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.075919 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1087/2176] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:46.076765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.087159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70bda-30f9-4635-9bc0-5e3066e9fae6 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.087429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9ba78-c49a-4868-8873-2875c5c7b3e0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.092959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.093677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.094144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.094536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.094827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.095379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:46.095817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.096003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.096986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.097405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] PATH_INFO: `/v3/projects/3b9e728eff8242a8b60a13e8beba0cf5/users/04703f876969466ba0dbbd44d11d578a/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.098449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.115346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1088/2177] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:46.116558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.125811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e728eff8242a8b60a13e8beba0cf5, user_id=04703f876969466ba0dbbd44d11d578a, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.128287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9219-c3cd-4d76-8ef4-b65c3fbb7712 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.130435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841924f-270a-4ed9-b649-0b5d4e1f1d67 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.133892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.134652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.134935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.135208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.136282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.139137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.151582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1090/2178] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:46 2022] PUT /identity/v3/projects/3b9e728eff8242a8b60a13e8beba0cf5/users/04703f876969466ba0dbbd44d11d578a/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:46.163729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.164314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.164595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.175516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1089/2179] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:46.179648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.198032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] MFA Rules not processed for user `04703f876969466ba0dbbd44d11d578a`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:46.199267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.290368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e9b16-2277-45bd-be54-af0bd6740dc6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.290629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1091/2180] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:46.295939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.298039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.298848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.299256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.299657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.300641 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.302817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.318231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6e74-80e0-47cb-aa60-2ca0ba25d441 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.327086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.331617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1090/2181] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:46.331778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.331778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.331778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.331778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.335044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.338084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.352454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10bf9-553d-4be7-a93c-c397095a45f8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.359589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.360501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.360885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.361250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.362479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.364416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.383886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1091/2182] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:46.383886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.397146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1133d-656d-418d-b108-ba3b9f6cd448 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.402801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.403611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1092/2183] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:46.407435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.407861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.408155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.409556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.409840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.411296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.425401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1092/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:46.429495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.445850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82097586-24a2-492e-9f82-d5f3d1ca3290 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.453165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:46.466032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:46.542008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.544179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.545372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.545905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] PATH_INFO: `/v3/projects/947aca5fa7374fbba60ca3229929171a/users/53580fb7acc1425f86eb5342fdea19b8/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.559288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f12a8-9628-4ece-93c2-dbff37faa155 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.565891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=947aca5fa7374fbba60ca3229929171a, user_id=53580fb7acc1425f86eb5342fdea19b8, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.567212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.567879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.568162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.568445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.568632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1d3af-5603-451b-9942-217147c5bf8b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.569073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.571024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.586139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1093/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:46 2022] PUT /identity/v3/projects/947aca5fa7374fbba60ca3229929171a/users/53580fb7acc1425f86eb5342fdea19b8/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:46.596061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1093/2186] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:46.600620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.601688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.602205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.602884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.611852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749afdf-5f5d-4e59-9e27-f8cc3814653e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.639750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] MFA Rules not processed for user `53580fb7acc1425f86eb5342fdea19b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:46.641136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.675379 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.676719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.677022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.677338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.678170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.680296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.693782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1094/2187] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:46.698827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.722458 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d1f0-a569-4eb7-a98a-116111fa32c5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.735425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1094/2188] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:46.735729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.736592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.736992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.737359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.738102 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.741362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.750056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.753016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.754023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1095/2189] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:46.758720 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:46.771478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e74e0d-a2f9-4380-8457-bdb91d904486 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.776662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.777670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.778092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.778450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] PATH_INFO: `/v3/projects/b7e7940c16444039928139584a945fd9/users/2d85f22c1f45482898f64eb8f358962f/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.799001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e7940c16444039928139584a945fd9, user_id=2d85f22c1f45482898f64eb8f358962f, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:46.802179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b150ba-3ef4-4e5c-b4e9-1b7873aaee2b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:46.826684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1096/2190] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:46 2022] PUT /identity/v3/projects/b7e7940c16444039928139584a945fd9/users/2d85f22c1f45482898f64eb8f358962f/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:46.838610 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933691c7-1730-4753-9a73-d140a72b399f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.838900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933691c7-1730-4753-9a73-d140a72b399f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.839180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933691c7-1730-4753-9a73-d140a72b399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.865137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb513b8e-58b4-47d9-8e7e-a51df7fffa79 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:46.875662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-933691c7-1730-4753-9a73-d140a72b399f None None] MFA Rules not processed for user `2d85f22c1f45482898f64eb8f358962f`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:46.875662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-933691c7-1730-4753-9a73-d140a72b399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:46.907978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:46.950474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:46.951173 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:46.951517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:46.951891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:46.967486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:46.985880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1097/2191] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:46.990942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933691c7-1730-4753-9a73-d140a72b399f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.024379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.027579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.039252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1095/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:47.095964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933691c7-1730-4753-9a73-d140a72b399f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.101555 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.102475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.102753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.103021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.103687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.105605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.144300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1098/2193] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:46 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:47.150334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.163384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef50a8-e27a-4e28-8966-86daca905b28 service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.243371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.244061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.244339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.244610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.245262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.247201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.269624 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1096/2194] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:47 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:47.273494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.284621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e197-5ea5-4119-a953-8001c3a913f2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.289360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.289984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.290256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.290527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.291161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.292793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.304221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1099/2195] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:47.308472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.322468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c7ba-abe4-4875-bb6f-6d2d00c7f627 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.327031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.327723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.328004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.328278 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] PATH_INFO: `/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a/users/3cac5f312c5e47938d575d069d4038a4/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.344321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd321d45f14ac0b9f2607b4c543b5a, user_id=3cac5f312c5e47938d575d069d4038a4, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.347783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.361077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1097/2196] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:47 2022] PUT /identity/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a/users/3cac5f312c5e47938d575d069d4038a4/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:47.365865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.376215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ead4-4b7c-4922-b323-f237f0e4da8a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.435928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.436634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.437052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.437397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.438118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.439835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb446ffb-b5a3-4332-98a5-cd72c849af5e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.456164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1100/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:47.460583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.472211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412da3d-3dcd-47b6-9e60-cbbc3bd1e95f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.477556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.478328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.478828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.479193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] PATH_INFO: `/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a/users/3cac5f312c5e47938d575d069d4038a4/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.481299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd321d45f14ac0b9f2607b4c543b5a, user_id=3cac5f312c5e47938d575d069d4038a4, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.496718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.514543 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1098/2198] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:47 2022] PUT /identity/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a/users/3cac5f312c5e47938d575d069d4038a4/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:47.524545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.524834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.525110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.561578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] MFA Rules not processed for user `3cac5f312c5e47938d575d069d4038a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:47.562774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:47.614390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:47.637026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1101/2199] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:47.649131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:47.655779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:47.693864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:47.717953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80b589-c8d2-4d4a-bc10-c74ffcf01fba admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:47.722282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:47.722883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:47.723154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:47.723418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:47.780709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:47.782135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:47.791629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1099/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:51.434757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:51.436421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:51.450896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddc041-41bb-4ce3-b464-628e37020005 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:51.458397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:51.459114 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:51.459499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:51.459900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:51.528421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:51.530005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550beef-e0e5-4537-a387-5d28be8f8e7c service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:51.540030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1102/2201] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:51.929905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:51.931423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.004883 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd01fe-6866-4d36-91c4-cf1820b6af26 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:52.010678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:52.011369 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.011676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.011957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] PATH_INFO: `/v3/users/48550a8edc5943a3a8b9f59af769e464` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.013402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48550a8edc5943a3a8b9f59af769e464)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:52.015068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:52.067028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48550a8edc5943a3a8b9f59af769e464'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.079294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48550a8edc5943a3a8b9f59af769e464'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.080027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48550a8edc5943a3a8b9f59af769e464'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.090717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48550a8edc5943a3a8b9f59af769e464'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.091665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48550a8edc5943a3a8b9f59af769e464'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.121437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1100/2202] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:51 2022] DELETE /identity/v3/users/48550a8edc5943a3a8b9f59af769e464 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:52.126236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.126748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.127907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.150202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:52.151192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.228665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1103/2203] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:52.238870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:52.240300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.253531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:52.262507 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:52.264423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.347669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474126-1a8e-459e-a9de-e7b800465e29 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:52.353488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eb416-9a9a-4ae5-9d9d-27b7d96937ca None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:52.355415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:52.356827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.357169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:52.357445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.357770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.358048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.358202 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.358383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.360103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.398291 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:52.400215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:52.428563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1101/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:52.466913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:52.495906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:52.497374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:52.508278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1104/2205] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:52.763175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:52.764785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:52.779473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dadbde-9690-40b4-9f73-d7f39c1ee5ff service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:52.784847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:52.785486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.785761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.786035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] PATH_INFO: `/v3/projects/54daaad2d8ac415493295ca46d482441` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.787154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54daaad2d8ac415493295ca46d482441)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:52.790286 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:52.837710 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54daaad2d8ac415493295ca46d482441', 'request_id': 'req-3a15e316-4b89-4595-b701-20fb214554d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.843697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54daaad2d8ac415493295ca46d482441', 'request_id': 'req-3a15e316-4b89-4595-b701-20fb214554d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.852360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54daaad2d8ac415493295ca46d482441', 'request_id': 'req-3a15e316-4b89-4595-b701-20fb214554d6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.864955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] The token cache is being invalidate because project 54daaad2d8ac415493295ca46d482441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:52.865270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.866007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:52.867726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1102/2206] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:52 2022] DELETE /identity/v3/projects/54daaad2d8ac415493295ca46d482441 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:52.872021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:52.884941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade87c64-c311-4607-8dec-e8f2c4841623 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:52.957003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:52.957913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:52.958190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:52.958448 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] PATH_INFO: `/v3/users/37d2112a887e4d07aeef2b0db92710a2` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:52.961172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d2112a887e4d07aeef2b0db92710a2)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:52.972428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:53.025880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d2112a887e4d07aeef2b0db92710a2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.046080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d2112a887e4d07aeef2b0db92710a2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.058002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d2112a887e4d07aeef2b0db92710a2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.058752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d2112a887e4d07aeef2b0db92710a2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.069032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d2112a887e4d07aeef2b0db92710a2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.076792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1105/2207] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:52 2022] DELETE /identity/v3/users/37d2112a887e4d07aeef2b0db92710a2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:53.383238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:53.385041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:53.399529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15e316-4b89-4595-b701-20fb214554d6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:53.464892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:53.465523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:53.465847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:53.466335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] PATH_INFO: `/v3/projects/635459a412174c8c9defff47ba7b69de` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:53.467938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635459a412174c8c9defff47ba7b69de)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:53.469885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:53.514185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:53.526868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635459a412174c8c9defff47ba7b69de', 'request_id': 'req-2514b1dc-efdf-41de-a5a9-635c63daf907'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.534231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635459a412174c8c9defff47ba7b69de', 'request_id': 'req-2514b1dc-efdf-41de-a5a9-635c63daf907'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.545510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635459a412174c8c9defff47ba7b69de', 'request_id': 'req-2514b1dc-efdf-41de-a5a9-635c63daf907'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.559316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] The token cache is being invalidate because project 635459a412174c8c9defff47ba7b69de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:53.559827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.560516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.562054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1103/2208] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:53 2022] DELETE /identity/v3/projects/635459a412174c8c9defff47ba7b69de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:53.567118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:53.568744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:53.583275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7afe6-cbf2-44dc-b3fe-5e7de9e435df admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:53.645039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:53.653683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:53.654625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:53.655072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:53.655591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] PATH_INFO: `/v3/users/919ec059e6024ecd9015efe209d7bad1` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:53.656966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=919ec059e6024ecd9015efe209d7bad1)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:53.659085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:53.729390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919ec059e6024ecd9015efe209d7bad1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.745168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919ec059e6024ecd9015efe209d7bad1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.756587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919ec059e6024ecd9015efe209d7bad1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.757399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919ec059e6024ecd9015efe209d7bad1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.769470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ac142ff2-97c6-4aa8-b338-c87dd24eb8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919ec059e6024ecd9015efe209d7bad1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:53.776212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1106/2209] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:53 2022] DELETE /identity/v3/users/919ec059e6024ecd9015efe209d7bad1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:54.119509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.121087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:54.136348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514b1dc-efdf-41de-a5a9-635c63daf907 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.200611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.201240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.201517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.201785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] PATH_INFO: `/v3/projects/b246231aefa649c89cc1b31db8a4964a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.202928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b246231aefa649c89cc1b31db8a4964a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.204850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.255171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b246231aefa649c89cc1b31db8a4964a', 'request_id': 'req-962f7641-d729-47ce-80bb-465d4a328c17'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:54.260788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b246231aefa649c89cc1b31db8a4964a', 'request_id': 'req-962f7641-d729-47ce-80bb-465d4a328c17'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:54.269352 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b246231aefa649c89cc1b31db8a4964a', 'request_id': 'req-962f7641-d729-47ce-80bb-465d4a328c17'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:54.280842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] The token cache is being invalidate because project b246231aefa649c89cc1b31db8a4964a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:54.281127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:54.281766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-962f7641-d729-47ce-80bb-465d4a328c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:54.283882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1104/2210] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:54 2022] DELETE /identity/v3/projects/b246231aefa649c89cc1b31db8a4964a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:54.289672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.289957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.290231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.310603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:54.311563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:54.373028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1107/2211] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:54.382943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.383226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.383704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.403814 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:54.404932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:54.413118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1105/2212] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:54.417428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.429654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097042c0-af41-45fc-8277-c7a3de46e4be None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.434367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.434970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.435244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.435509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.436186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:54.436484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.438081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.452451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1108/2213] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:54.456686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.466243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323cb11-558f-4914-9cd4-be394e93fe91 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.471321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.472117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.472517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.472822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.473592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.475668 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.505650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1106/2214] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:54.509616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.519855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ecc49-a468-4a1c-9de0-3cb79ec2dd7e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.580699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.581366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.581566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.581835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.582718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.584670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.593314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:54.607477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1109/2215] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:54.612215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.624285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c482-c18f-4ecd-904a-3e4259527578 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.629816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.630427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.630709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.630985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.631676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.633275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.643342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1107/2216] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:54.647480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.657855 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ee50c-af21-480d-a54f-e618086f6c37 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.663294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.663944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.664221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.664495 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.665211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.666836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606c20-a65d-4605-a081-c96cee6491fd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.679193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1110/2217] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:54.683407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.694235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6eb4-8f38-4218-b040-8a281167021b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.698841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.699485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.699800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.700078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] PATH_INFO: `/v3/projects/fff0742969184538a7b6b8501baab3ef/users/1e4d785107c84cf29aa8859b65612afc/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.711382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:54.716002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff0742969184538a7b6b8501baab3ef, user_id=1e4d785107c84cf29aa8859b65612afc, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.719748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.733501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1108/2218] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:54 2022] PUT /identity/v3/projects/fff0742969184538a7b6b8501baab3ef/users/1e4d785107c84cf29aa8859b65612afc/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:54.745410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.745803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.746083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.774021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] MFA Rules not processed for user `1e4d785107c84cf29aa8859b65612afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:54.775247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:54.841373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1111/2219] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:54.847159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.917819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb6f89-c730-437f-b66c-3a6d54fa39c3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:54.922780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:54.923428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:54.923711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:54.924682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:54.925359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:54.927253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:54.962652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1109/2220] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:54.963796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:54.978050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3dfbe-0e70-452e-96b0-eae16639be5e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.072788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.073459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.073799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.074075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.074698 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.076671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.107145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1112/2221] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:54 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:55.111196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.131203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe69b-00ce-4505-8b02-f47639fdd907 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.140955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.141282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.141565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.141937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.143498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.146564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.163969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1110/2222] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:55.167041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.180342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ed5b-15cb-4596-a4bf-80e6c6d64a8a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.187021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.187848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.188426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.188710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] PATH_INFO: `/v3/projects/cf3c610686374839808dc694ba1ef1f6/users/051a3ed139c44323b1449a3737a78264/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.208219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3c610686374839808dc694ba1ef1f6, user_id=051a3ed139c44323b1449a3737a78264, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.210944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.227485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1113/2223] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:55 2022] PUT /identity/v3/projects/cf3c610686374839808dc694ba1ef1f6/users/051a3ed139c44323b1449a3737a78264/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:55.231979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.242582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fbd5-7451-4de8-93b5-a503428758d4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.316415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.317357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.317865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.318248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.318970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.325388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94946d-7fa7-422c-8648-570df4c47d03 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.333452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1111/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:55.338317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.373354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f9c7-4633-415a-8d9d-c1fada50061e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.400765 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.401809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.401809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.402059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] PATH_INFO: `/v3/projects/cf3c610686374839808dc694ba1ef1f6/users/051a3ed139c44323b1449a3737a78264/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.419761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3c610686374839808dc694ba1ef1f6, user_id=051a3ed139c44323b1449a3737a78264, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.422631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.440674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1114/2225] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:55 2022] PUT /identity/v3/projects/cf3c610686374839808dc694ba1ef1f6/users/051a3ed139c44323b1449a3737a78264/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:55.451855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697978-864e-43b0-8634-5de86476d719 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.452413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697978-864e-43b0-8634-5de86476d719 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.452413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697978-864e-43b0-8634-5de86476d719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.495405 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-50697978-864e-43b0-8634-5de86476d719 None None] MFA Rules not processed for user `051a3ed139c44323b1449a3737a78264`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:55.499566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-50697978-864e-43b0-8634-5de86476d719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:55.586023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:55.622463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1112/2226] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:55.634562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.637530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:55.668006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:55.703616 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f7e0-5e91-4558-8baf-60b5528af7e7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.708498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.709106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.709385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.709657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.725647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.727567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4781c94-15b0-4d87-bc81-14502373ee68 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:55.739446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1115/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:55.887713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697978-864e-43b0-8634-5de86476d719 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:55.950443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697978-864e-43b0-8634-5de86476d719 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:55.954946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:55.955634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:55.955916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:55.956191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] PATH_INFO: `/v3/users/1e4d785107c84cf29aa8859b65612afc` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:55.957322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4d785107c84cf29aa8859b65612afc)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:55.959520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:56.009459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4d785107c84cf29aa8859b65612afc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.023002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4d785107c84cf29aa8859b65612afc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.023841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4d785107c84cf29aa8859b65612afc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.031527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4d785107c84cf29aa8859b65612afc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.032212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4d785107c84cf29aa8859b65612afc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.046529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1113/2228] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:55 2022] DELETE /identity/v3/users/1e4d785107c84cf29aa8859b65612afc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:56.052220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.052738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.053189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.076179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:56.077532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.180906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1116/2229] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:56.193383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:56.194836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.264973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802a40-3479-410f-9f3d-551c607efe55 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:56.269484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:56.270207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.270621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.271084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.292336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:56.293927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b7a82-2308-4d82-a0f9-49c9ee760f5e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:56.302490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:56.305297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.310204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1114/2230] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:56.318725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d92fd1-07ff-4aa6-ac4f-83a5bdf44d21 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:56.323599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:56.324380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.324481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.324758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] PATH_INFO: `/v3/users/a25f25f08e904499949193cc17387286` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.326183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25f25f08e904499949193cc17387286)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:56.329620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:56.400888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25f25f08e904499949193cc17387286'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.426466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25f25f08e904499949193cc17387286'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.439897 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25f25f08e904499949193cc17387286'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.441894 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25f25f08e904499949193cc17387286'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.451147 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25f25f08e904499949193cc17387286'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.460113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1117/2231] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:56 2022] DELETE /identity/v3/users/a25f25f08e904499949193cc17387286 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:56.465586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.466101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.466333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.529325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:56.548605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:56.550397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.744351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1115/2232] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:38:56.754834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:56.757101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.796709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:56.799806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.821267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0feb4a-5d1a-4fe9-a695-007b8c516f1a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:56.843101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:56.844648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.844944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.845209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] PATH_INFO: `/v3/users/04703f876969466ba0dbbd44d11d578a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.847136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04703f876969466ba0dbbd44d11d578a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:56.849323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:56.856330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:56.891902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a234810-2e4e-4bb9-8f9e-b5cfec6ffacf admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:56.905615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:56.906619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:56.907150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:56.907299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:56.919671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:56.921101 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:56.935948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1118/2233] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:56.943528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:56.946849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:56.975855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04703f876969466ba0dbbd44d11d578a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:56.979491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12dc0d-13f5-4b9b-ba05-a4c1c1f2735c service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.004888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04703f876969466ba0dbbd44d11d578a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.006472 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04703f876969466ba0dbbd44d11d578a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.020631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.021668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.022095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.022832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] PATH_INFO: `/v3/projects/fff0742969184538a7b6b8501baab3ef` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.024567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff0742969184538a7b6b8501baab3ef)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.027089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.048866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04703f876969466ba0dbbd44d11d578a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.049713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f5fdffcd-31e8-4b67-91ab-cbea441dbd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04703f876969466ba0dbbd44d11d578a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.092082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1116/2234] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:56 2022] DELETE /identity/v3/users/04703f876969466ba0dbbd44d11d578a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:38:57.092082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.092082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.093649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.112902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff0742969184538a7b6b8501baab3ef', 'request_id': 'req-ea38873f-27be-4587-804e-dda02c1028e9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.121069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff0742969184538a7b6b8501baab3ef', 'request_id': 'req-ea38873f-27be-4587-804e-dda02c1028e9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.141574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff0742969184538a7b6b8501baab3ef', 'request_id': 'req-ea38873f-27be-4587-804e-dda02c1028e9'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.141836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:57.144049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.164640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] The token cache is being invalidate because project fff0742969184538a7b6b8501baab3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:57.165407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.166373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.168493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1119/2235] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:56 2022] DELETE /identity/v3/projects/fff0742969184538a7b6b8501baab3ef => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:57.174525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.176504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.262667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1117/2236] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:57.269214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.274238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.320789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38873f-27be-4587-804e-dda02c1028e9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.326739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.327663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.328159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:57.328714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.329061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] PATH_INFO: `/v3/users/051a3ed139c44323b1449a3737a78264` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.331337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051a3ed139c44323b1449a3737a78264)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.333799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.380132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93378db7-b198-4343-8f7e-f9f3b797c612 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.386841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.387633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.387961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.388287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.401619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.406080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.420733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051a3ed139c44323b1449a3737a78264'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.428026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1118/2237] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:38:57.443570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.448234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.467916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051a3ed139c44323b1449a3737a78264'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.470728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:57.481831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5c12-483c-4e79-8036-20f9b3a78aab service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.483573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051a3ed139c44323b1449a3737a78264'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.484764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051a3ed139c44323b1449a3737a78264'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.494182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.495336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.495646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-ae5b0e02-5873-4e60-831f-3f073459c778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051a3ed139c44323b1449a3737a78264'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.495966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.496391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] PATH_INFO: `/v3/projects/bdedf1cf88384d87ba30734e15a58794` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.497788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdedf1cf88384d87ba30734e15a58794)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.500699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.520644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1120/2238] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:57 2022] DELETE /identity/v3/users/051a3ed139c44323b1449a3737a78264 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:57.561145 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdedf1cf88384d87ba30734e15a58794', 'request_id': 'req-abc0ba56-1905-4099-b1de-d7dfce01d733'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.569106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdedf1cf88384d87ba30734e15a58794', 'request_id': 'req-abc0ba56-1905-4099-b1de-d7dfce01d733'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.578445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdedf1cf88384d87ba30734e15a58794', 'request_id': 'req-abc0ba56-1905-4099-b1de-d7dfce01d733'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.593326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] The token cache is being invalidate because project bdedf1cf88384d87ba30734e15a58794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:57.594930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.596072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-abc0ba56-1905-4099-b1de-d7dfce01d733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.598502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1119/2239] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:57 2022] DELETE /identity/v3/projects/bdedf1cf88384d87ba30734e15a58794 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:57.606723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.607015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.607348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.649697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:57.651284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.754853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1121/2240] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:57.757007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.757410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.757977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.807355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:57.809993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.819743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1120/2241] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:57.822663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.838764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.840294 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.856384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c639-53fe-451c-996a-667676cfccb8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.857552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11fb47-c061-4edf-9ec3-7575f441eb5d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.864917 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.865602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.865876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.866147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] PATH_INFO: `/v3/projects/3b9e728eff8242a8b60a13e8beba0cf5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.867391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9e728eff8242a8b60a13e8beba0cf5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.869413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.874227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.876752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.877767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.878103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.878728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:57.879037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.884166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:57.905761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1122/2242] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:57.907002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.910189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.925950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65161d2-3211-4b87-98ac-52806750ce1a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:57.939566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9e728eff8242a8b60a13e8beba0cf5', 'request_id': 'req-987bfdee-9116-4135-8f7d-1172ba5b5c5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.945231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9e728eff8242a8b60a13e8beba0cf5', 'request_id': 'req-987bfdee-9116-4135-8f7d-1172ba5b5c5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.954868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9e728eff8242a8b60a13e8beba0cf5', 'request_id': 'req-987bfdee-9116-4135-8f7d-1172ba5b5c5e'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.966728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] The token cache is being invalidate because project 3b9e728eff8242a8b60a13e8beba0cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:57.966943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.967640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:57.969155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1121/2243] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:57 2022] DELETE /identity/v3/projects/3b9e728eff8242a8b60a13e8beba0cf5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:57.969921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:57.971961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:57.993257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:57.994076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:57.994359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:57.994714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] PATH_INFO: `/v3/projects/cf3c610686374839808dc694ba1ef1f6` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:57.995966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3c610686374839808dc694ba1ef1f6)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:57.997918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.003870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:58.046078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bfdee-9116-4135-8f7d-1172ba5b5c5e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.054025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3c610686374839808dc694ba1ef1f6', 'request_id': 'req-4a110c02-161f-4d9b-931f-64325545a04f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.061294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3c610686374839808dc694ba1ef1f6', 'request_id': 'req-4a110c02-161f-4d9b-931f-64325545a04f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.071974 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3c610686374839808dc694ba1ef1f6', 'request_id': 'req-4a110c02-161f-4d9b-931f-64325545a04f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.085651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:58.089905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] The token cache is being invalidate because project cf3c610686374839808dc694ba1ef1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:58.090413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.091803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.093427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1123/2244] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:57 2022] DELETE /identity/v3/projects/cf3c610686374839808dc694ba1ef1f6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:58.094248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.095693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.127864 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.128657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.129043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.129557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.130896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.134554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e87e47-66bc-413b-a5c5-b6770a414838 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.175783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1122/2245] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:57 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:58.178032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.178515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.179063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.193780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c02-161f-4d9b-931f-64325545a04f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.203329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:58.204680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.296343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.297289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.297753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.298384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] PATH_INFO: `/v3/users/2d85f22c1f45482898f64eb8f358962f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.299293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1123/2246] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:58.300285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.301662 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.308815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d85f22c1f45482898f64eb8f358962f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.311240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.315198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc0559-f256-41a6-a2fc-eda692d02dc5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.324325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.326204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.326494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.326968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.327589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.330773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb50f9-0b70-42fb-aead-cebb6933be95 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.368382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1124/2247] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:58.370002 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.370590 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.370863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.382824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d85f22c1f45482898f64eb8f358962f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.394114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:58.395586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.402615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d85f22c1f45482898f64eb8f358962f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.409355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1125/2248] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:58.410282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.415767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d85f22c1f45482898f64eb8f358962f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.416407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d85f22c1f45482898f64eb8f358962f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.420948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee1121-648e-4f68-8254-1206d606fa7e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.428227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d85f22c1f45482898f64eb8f358962f'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:58.429822 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.430417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.430695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.431571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.431742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.433384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.436726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1124/2249] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:58 2022] DELETE /identity/v3/users/2d85f22c1f45482898f64eb8f358962f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:58.437745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.439237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.451194 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1126/2250] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:58.452151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.453988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.467660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799353-e201-49c0-873c-52948ebf7c5f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.477598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:58.488454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:58.529736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e6be-bee3-4d46-adee-b580ce36b598 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.536201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.536834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.537116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.537551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.538214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:38:58.538522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.540240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.551926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.554984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.558532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1125/2251] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:38:58.562833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.563601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.564161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.566733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.568521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.575083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d77645-d192-471f-af84-8c0fed74badf admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.588664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.589415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.589774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.590066 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.590793 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.593182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.599907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1127/2252] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:58.600702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.626658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf79c-63e6-4ced-9dbd-5487667a0b8d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.632887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.633594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.633871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.634151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] PATH_INFO: `/v3/projects/d55b918b6a28499299cded2394b79cfb/users/61614acde27844788d9f6ce14cbddc1d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.649490 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1126/2253] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:58.650543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.655817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55b918b6a28499299cded2394b79cfb, user_id=61614acde27844788d9f6ce14cbddc1d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.660510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372344f-846e-41aa-9bc5-2c76dc9e3002 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.698739 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1128/2254] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:58 2022] PUT /identity/v3/projects/d55b918b6a28499299cded2394b79cfb/users/61614acde27844788d9f6ce14cbddc1d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:58.700812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.701143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.701804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.737915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] MFA Rules not processed for user `61614acde27844788d9f6ce14cbddc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:58.739316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.769605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ffabd-a54d-4e35-b53c-6bb02bbadac1 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.845356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1129/2255] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:58.847963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.849680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.870453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.871182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.871558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.871902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.872607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.874803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.900681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1127/2256] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:58 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:58.901609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:58.903274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:58.943750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931ea71-b45a-45f3-9236-3acf853c6e33 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.949525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.950973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.951299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.951514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] PATH_INFO: `/v3/projects/b7e7940c16444039928139584a945fd9` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.954024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e7940c16444039928139584a945fd9)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:58.954606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:58.955093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:58.980508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3ea7b-b747-44d5-bd77-78458004f9f5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:58.988694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:58.988694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:58.988694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:58.988694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:58.993004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:59.000145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.002588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.013905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1128/2257] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:38:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:38:59.014332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.025339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817504c-6d4f-408d-a296-75261b9d6880 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.032032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e7940c16444039928139584a945fd9', 'request_id': 'req-9d4d174d-9eea-464f-84e6-bc576a7619da'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.043520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e7940c16444039928139584a945fd9', 'request_id': 'req-9d4d174d-9eea-464f-84e6-bc576a7619da'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.058254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e7940c16444039928139584a945fd9', 'request_id': 'req-9d4d174d-9eea-464f-84e6-bc576a7619da'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.076742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] The token cache is being invalidate because project b7e7940c16444039928139584a945fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:38:59.077044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.077750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.080213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1130/2258] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:58 2022] DELETE /identity/v3/projects/b7e7940c16444039928139584a945fd9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:59.084604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.086165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:59.102088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.102701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.102977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.103245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.104308 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.105641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.116799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1129/2259] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:59.120828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.122701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:59.136214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c941-1c1c-47fc-b7a7-9e5446751a43 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.141442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.142010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.142423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.143800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.143914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.145460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.160235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1130/2260] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:38:59.160911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.170980 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673cbf-daae-4469-b2ed-77e9e1412289 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.176513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.177299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.177671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.178044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] PATH_INFO: `/v3/projects/588ad265063647979ead36353d3d8922/users/e008ef296d7d4458bf44a8c329ce3b87/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.190478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d174d-9eea-464f-84e6-bc576a7619da admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.199231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.200395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.200671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.200942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] PATH_INFO: `/v3/users/3cac5f312c5e47938d575d069d4038a4` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.202444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cac5f312c5e47938d575d069d4038a4)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.204839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.207885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=588ad265063647979ead36353d3d8922, user_id=e008ef296d7d4458bf44a8c329ce3b87, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.213658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461ab2-b9fa-414f-9d4f-d6e9016ea73d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.245915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1131/2261] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:59 2022] PUT /identity/v3/projects/588ad265063647979ead36353d3d8922/users/e008ef296d7d4458bf44a8c329ce3b87/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:59.247413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.247823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.248073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.294296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cac5f312c5e47938d575d069d4038a4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.312990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] MFA Rules not processed for user `e008ef296d7d4458bf44a8c329ce3b87`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:38:59.315757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:59.323764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cac5f312c5e47938d575d069d4038a4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.325123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cac5f312c5e47938d575d069d4038a4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.339031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cac5f312c5e47938d575d069d4038a4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.339968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cac5f312c5e47938d575d069d4038a4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:38:59.368580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1131/2262] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:38:59 2022] DELETE /identity/v3/users/3cac5f312c5e47938d575d069d4038a4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:59.445684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1132/2263] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:38:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:38:59.450046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.452621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:59.516441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:59.576358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82485517-9c5f-41a6-8668-c71b6549eefe admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.587042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.587719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.587976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.588254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.588953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.591045 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.630005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1132/2264] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:38:59 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:38:59.634043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.703173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:59.775306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1eb46-ab59-4dbe-a02c-1343a40fc63f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.847650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.848316 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.848604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.848871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.849521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.851497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.879014 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1133/2265] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:38:59 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:38:59.880487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.894851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96618e59-fe0f-403a-a2c3-1826a2c9e146 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.900326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.901244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.901526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.901793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.902473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.904239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.916560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1133/2266] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:38:59.921271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.932163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67481-e594-4b95-9638-9eced85a4635 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:38:59.937207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:38:59.937824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:38:59.938119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:38:59.938417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] PATH_INFO: `/v3/projects/be82ff6646cc4500bb34c31cbc704b6b/users/52eb0f5e6b9a4a8c863c7466c23fdfa0/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:38:59.954056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be82ff6646cc4500bb34c31cbc704b6b, user_id=52eb0f5e6b9a4a8c863c7466c23fdfa0, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:38:59.957641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:38:59.978712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.979213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1134/2267] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:38:59 2022] PUT /identity/v3/projects/be82ff6646cc4500bb34c31cbc704b6b/users/52eb0f5e6b9a4a8c863c7466c23fdfa0/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:38:59.980570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:38:59.984748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:38:59.994568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d9f3-f23f-4514-af34-b12d7a7471aa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.062204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20085-c3d9-475b-8044-b09f61fcd74f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.068356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.068976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.069262 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.069703 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.069989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.070488 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.070601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.070874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.071150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] PATH_INFO: `/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.072163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.072433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cd321d45f14ac0b9f2607b4c543b5a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.074326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.084600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1135/2268] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:00.089153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:00.103795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a80a-797e-4b7f-aa58-1d06e8eb5a28 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.109018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.109757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.110170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.110341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] PATH_INFO: `/v3/projects/be82ff6646cc4500bb34c31cbc704b6b/users/52eb0f5e6b9a4a8c863c7466c23fdfa0/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.112790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be82ff6646cc4500bb34c31cbc704b6b, user_id=52eb0f5e6b9a4a8c863c7466c23fdfa0, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.118042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8476be-cd04-41fd-a6d4-a6658b2aab3b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.132198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1136/2269] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:00 2022] PUT /identity/v3/projects/be82ff6646cc4500bb34c31cbc704b6b/users/52eb0f5e6b9a4a8c863c7466c23fdfa0/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:00.138406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cd321d45f14ac0b9f2607b4c543b5a', 'request_id': 'req-2271e4fd-3a5e-4719-ad0d-955042042df9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.144195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.144753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.145101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cd321d45f14ac0b9f2607b4c543b5a', 'request_id': 'req-2271e4fd-3a5e-4719-ad0d-955042042df9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.145450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.154860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cd321d45f14ac0b9f2607b4c543b5a', 'request_id': 'req-2271e4fd-3a5e-4719-ad0d-955042042df9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.168164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] The token cache is being invalidate because project 81cd321d45f14ac0b9f2607b4c543b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:00.168440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.169120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.179363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1134/2270] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:38:59 2022] DELETE /identity/v3/projects/81cd321d45f14ac0b9f2607b4c543b5a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:00.181799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] MFA Rules not processed for user `52eb0f5e6b9a4a8c863c7466c23fdfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:00.182939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.204475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:00.295591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1137/2271] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:00.306872 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:00.308381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.349745 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:00.351459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.379110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:00.405684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271e4fd-3a5e-4719-ad0d-955042042df9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.436884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf5f6-8670-4fa8-837d-4a5ce9fc99bf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.443739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.444453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.444779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.445122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] PATH_INFO: `/v3/users/1fb687ba934c49ecb071580b06d60d1e` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.446460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb687ba934c49ecb071580b06d60d1e)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.448777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.460499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.461563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.461849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.462127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.474246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.475697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.487924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1135/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:00.512004 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb687ba934c49ecb071580b06d60d1e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.526219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb687ba934c49ecb071580b06d60d1e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.546439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb687ba934c49ecb071580b06d60d1e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.547099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb687ba934c49ecb071580b06d60d1e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.556019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb687ba934c49ecb071580b06d60d1e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:00.563028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1138/2273] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:00 2022] DELETE /identity/v3/users/1fb687ba934c49ecb071580b06d60d1e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:00.576810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:00.578227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.589907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7540bb2-bba2-45ce-ac0e-42c3dba18a82 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.655000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.655848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.656133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.656409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.658521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.735236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.737327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.749831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1136/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:00.773792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:00.775369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:00.829190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:00.877204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710b8f-5b9d-4c89-96f6-bd9e2e14c49f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:00.898221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:00.898886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:00.899177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:00.899443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] PATH_INFO: `/v3/projects/a30d9fac496847cabd82a65c805f0c2c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:00.902159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30d9fac496847cabd82a65c805f0c2c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:00.905109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:00.994534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30d9fac496847cabd82a65c805f0c2c', 'request_id': 'req-53c4b407-455e-4278-8ea4-9107574350c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.004192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30d9fac496847cabd82a65c805f0c2c', 'request_id': 'req-53c4b407-455e-4278-8ea4-9107574350c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.018399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30d9fac496847cabd82a65c805f0c2c', 'request_id': 'req-53c4b407-455e-4278-8ea4-9107574350c5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.050728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] The token cache is being invalidate because project a30d9fac496847cabd82a65c805f0c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:01.051090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.051837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.053932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1139/2275] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:00 2022] DELETE /identity/v3/projects/a30d9fac496847cabd82a65c805f0c2c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:01.058200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.077596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c88d3-ca61-4046-8c28-900af77d1a46 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.165276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:01.186610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.187420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.187799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.188146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] PATH_INFO: `/v3/users/9a33baeb65a3474e816c05f2396c171f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.189462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a33baeb65a3474e816c05f2396c171f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:01.191528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:01.250209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a33baeb65a3474e816c05f2396c171f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.262759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a33baeb65a3474e816c05f2396c171f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.263621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a33baeb65a3474e816c05f2396c171f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.272189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a33baeb65a3474e816c05f2396c171f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.272921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2b2339b3-d791-4c93-8020-e7e947a52e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a33baeb65a3474e816c05f2396c171f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.286898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1137/2276] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:01 2022] DELETE /identity/v3/users/9a33baeb65a3474e816c05f2396c171f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:01.481299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.482870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:01.497269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4b407-455e-4278-8ea4-9107574350c5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.558672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.559314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.559612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.559886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] PATH_INFO: `/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.561002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e17e05a1fd4c5f9ebee6950623d77f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:01.562903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:01.628896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e17e05a1fd4c5f9ebee6950623d77f', 'request_id': 'req-df47a963-f993-47a3-95d5-4b8dad9cd7b6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.635671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e17e05a1fd4c5f9ebee6950623d77f', 'request_id': 'req-df47a963-f993-47a3-95d5-4b8dad9cd7b6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.638154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:01.645328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e17e05a1fd4c5f9ebee6950623d77f', 'request_id': 'req-df47a963-f993-47a3-95d5-4b8dad9cd7b6'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.657450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] The token cache is being invalidate because project f7e17e05a1fd4c5f9ebee6950623d77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:01.657739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.658917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-df47a963-f993-47a3-95d5-4b8dad9cd7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:01.660432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1140/2277] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:01 2022] DELETE /identity/v3/projects/f7e17e05a1fd4c5f9ebee6950623d77f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:01.665323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.665798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.665889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.685910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:01.687209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:01.753931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1138/2278] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:01.755983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.756301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.756576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.777172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:01.778394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:01.787081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1141/2279] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:01.791649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.802210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ccbf-38cc-49c9-999f-6ae8f4e798cf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.807754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.808290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.808566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.808833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.809480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:01.809782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:01.811353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:01.823389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1139/2280] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:01.827322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.837361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0734-22d8-4f39-88ba-ea97101d0fab None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.841929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.842524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.842800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.843069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.843728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:01.846237 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:01.874364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1142/2281] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:01 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:01.878577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.889152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd78f-200f-4a31-a063-0f9e1b8aaa41 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.939303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:01.948003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.949946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:01.950301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:01.950916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:01.951658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:01.954225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:01.979972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1140/2282] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:01 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:01.984239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:01.994621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228100f8-a5fe-4d06-b804-77528aa5d437 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:01.999219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:01.999852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.000130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.000416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.001041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.002655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.013853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1143/2283] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:02.018329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:02.028621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59236bee-e162-44d5-92f3-36dc6fcc2549 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:02.033988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:02.034941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.035275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.035658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.036359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.037984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d2fd-d302-4ee7-a59e-babf3319123a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.050732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1141/2284] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:02.055020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:02.066177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af2ce-283f-4444-a669-06b9af3edbcd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:02.069999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:02.070657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.070928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.071195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] PATH_INFO: `/v3/projects/0fca86022ec84f6d98810246010c03af/users/c911c473904d4a64b63de6f3fb49b730/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.088759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fca86022ec84f6d98810246010c03af, user_id=c911c473904d4a64b63de6f3fb49b730, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.091313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.106634 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1144/2285] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:02 2022] PUT /identity/v3/projects/0fca86022ec84f6d98810246010c03af/users/c911c473904d4a64b63de6f3fb49b730/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:02.117808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.118094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.118373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.146621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] MFA Rules not processed for user `c911c473904d4a64b63de6f3fb49b730`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:02.147990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:02.223891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1142/2286] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:02.257301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:02.258989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:02.330876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c88af-4f1d-4dda-b3a8-c32f2fb082d7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:02.334808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:02.335442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.335760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.336030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.344464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.345882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60bd2f-e1d2-4bc7-b3d4-25c65d61b12a service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.354857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1145/2287] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:02.372038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:02.447950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dc3b9-94eb-4573-9ef0-4a8186a283bb None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:02.453468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:02.454120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.454396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.454663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] PATH_INFO: `/v3/users/c911c473904d4a64b63de6f3fb49b730` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.456473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c911c473904d4a64b63de6f3fb49b730)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.458833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.519158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c911c473904d4a64b63de6f3fb49b730'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:02.533551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c911c473904d4a64b63de6f3fb49b730'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:02.534288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c911c473904d4a64b63de6f3fb49b730'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:02.536256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:02.543431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c911c473904d4a64b63de6f3fb49b730'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:02.544402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c911c473904d4a64b63de6f3fb49b730'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:02.567326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.567775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.568189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.570055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1143/2288] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:02 2022] DELETE /identity/v3/users/c911c473904d4a64b63de6f3fb49b730 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:02.590929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:02.592370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:02.668818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1146/2289] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:02.678889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:02.680350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:02.739118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d79e0-c691-4641-81cc-d690292aea0e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:02.742921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:02.743528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:02.743834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:02.744221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:02.753992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:02.755443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c048b3-3e87-4029-8311-03be83eed834 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:02.765593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1144/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:03.061457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.063749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:03.077957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862d7af-c895-490c-902e-06d97c275f97 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.084517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.085441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.085865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.086310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] PATH_INFO: `/v3/projects/0fca86022ec84f6d98810246010c03af` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.087759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fca86022ec84f6d98810246010c03af)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.090217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.121786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:03.146869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fca86022ec84f6d98810246010c03af', 'request_id': 'req-d905512c-3003-4fb3-b881-9e26e920a8e3'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:03.153684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fca86022ec84f6d98810246010c03af', 'request_id': 'req-d905512c-3003-4fb3-b881-9e26e920a8e3'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:03.163390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fca86022ec84f6d98810246010c03af', 'request_id': 'req-d905512c-3003-4fb3-b881-9e26e920a8e3'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:03.179253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] The token cache is being invalidate because project 0fca86022ec84f6d98810246010c03af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:03.179667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:03.181891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-d905512c-3003-4fb3-b881-9e26e920a8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:03.184045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1147/2291] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:03 2022] DELETE /identity/v3/projects/0fca86022ec84f6d98810246010c03af => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:03.189916 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.190505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.191817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.217116 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:03.218488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:03.311437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1145/2292] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:03.313434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.313722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.313995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.343057 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:03.344401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:03.354110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1148/2293] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:03.358367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.370210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49abcf-3e75-44b4-aa69-06dcf5ab58e4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.375429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.376096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.376465 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.377382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.378103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:03.378476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.380178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.407254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1146/2294] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:03.408431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.421613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192da8e-2e1f-4856-88bb-583427186636 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.428197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.429042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.429496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.429936 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.430843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.433156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.473437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1149/2295] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:03 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:03.477380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.490092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd21a-94bf-40f8-a8dd-386d267d1c82 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.605440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.606466 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.607000 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.607419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.608349 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.610429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.637065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1147/2296] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:03 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:03.638590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.648924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c4bd-ed88-4d71-a472-f498adefc759 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.653472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.654063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.654338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.654606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.655241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.656871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.669527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1150/2297] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:03.670598 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.676447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:03.682735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d571b43-c5ca-40f5-bfbb-927bf375f1d7 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.690370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.691162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.691720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.692097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.693063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.695284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a35cce-d74b-40e5-9772-e2c673a59ea5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.708528 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1148/2298] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:03.712505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.726385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba070ca-b8e4-4378-9daa-e851f4004ccd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.731118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.731832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.732098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.732371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] PATH_INFO: `/v3/projects/0d438b7302cd4a2cb101ce4b5574994a/users/49e4fecfe40549f5a3a9d3c0ceb1c7af/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.748478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d438b7302cd4a2cb101ce4b5574994a, user_id=49e4fecfe40549f5a3a9d3c0ceb1c7af, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:03.751127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:03.767207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1151/2299] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:03 2022] PUT /identity/v3/projects/0d438b7302cd4a2cb101ce4b5574994a/users/49e4fecfe40549f5a3a9d3c0ceb1c7af/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:03.777392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.777676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.777946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:03.818366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] MFA Rules not processed for user `49e4fecfe40549f5a3a9d3c0ceb1c7af`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:03.819728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:03.899044 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1149/2300] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:03.912545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:03.914556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:03.988231 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bdddf-9d5b-457e-822c-991f89fa8aa8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:03.992625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:03.993529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:03.993529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:03.993852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:04.004827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:04.006455 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:04.018394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1152/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:39:05.214182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:05.216217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:05.289802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e523dd0-672f-4a60-a431-f8d5704fe2ff None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:05.294694 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:05.295363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:05.295676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:05.296699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] PATH_INFO: `/v3/users/51def7315f294e99ba206f5db1ef282f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:05.297139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51def7315f294e99ba206f5db1ef282f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:05.299750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:05.344930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51def7315f294e99ba206f5db1ef282f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.358824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51def7315f294e99ba206f5db1ef282f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.359569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51def7315f294e99ba206f5db1ef282f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.371494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51def7315f294e99ba206f5db1ef282f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.372377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cc68655-757a-4206-a839-b845e648802e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51def7315f294e99ba206f5db1ef282f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.382819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:05.388532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1150/2302] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:05 2022] DELETE /identity/v3/users/51def7315f294e99ba206f5db1ef282f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:05.569799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:05.586264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588b3-af96-4916-a689-1a521a734ac6 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:05.646590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:05.657402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:05.659089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:05.659821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:05.660043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] PATH_INFO: `/v3/projects/db908214d6fb40909a4728b207bf776a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:05.661331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db908214d6fb40909a4728b207bf776a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:05.663281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:05.715342 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db908214d6fb40909a4728b207bf776a', 'request_id': 'req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.721929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db908214d6fb40909a4728b207bf776a', 'request_id': 'req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.731864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db908214d6fb40909a4728b207bf776a', 'request_id': 'req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.744133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] The token cache is being invalidate because project db908214d6fb40909a4728b207bf776a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:05.744409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.745031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0dac9d8a-5a8f-49b2-a792-ad0b86ccda43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:05.746695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1153/2303] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:05 2022] DELETE /identity/v3/projects/db908214d6fb40909a4728b207bf776a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:05.752212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:05.752717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:05.753100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:05.776741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:05.778241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:05.911632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1151/2304] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:05.917776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:05.917776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:05.917776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:05.940340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:05.941566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:05.951912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1154/2305] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:05.954099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:05.969454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147545fa-1062-4c5f-b29c-221818d6c61a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:05.975223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:05.975960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:05.976314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:05.976726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:05.977439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:05.977850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:05.979580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:05.996902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1152/2306] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:06.001293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.012089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97788-6fb8-4949-bf17-b5d62a56b5c7 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.020186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.020808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.021069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.021333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.022108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.023951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.055572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1155/2307] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:06.057636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.068984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78261b-c68d-459b-a368-722c89c0a74f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.130253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.130873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.131155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.131430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.132117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.134027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.158351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1153/2308] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:06 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:06.162481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.173591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b00a1-4232-4f53-91f6-5527a982a5c7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.180078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.180261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.180505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.181083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.181772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.183961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.200328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1156/2309] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:06.204103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.220510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30571d-f5fd-4090-927d-e24b4fb88fdc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.226979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.227616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.227903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.228178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.228825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.230426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4373c9-bda6-482b-a2c9-795ab7b2c893 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.243046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1154/2310] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:06.248778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.260516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f519-14f2-4d58-ab7e-52d64ec8872b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.265295 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.265997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.266280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.266554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] PATH_INFO: `/v3/projects/5f4a18aee24d4fd3a7fdeeb18ef36a34/users/5aadd607eaef41b6b84b00a89d0a3ed2/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.287949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4a18aee24d4fd3a7fdeeb18ef36a34, user_id=5aadd607eaef41b6b84b00a89d0a3ed2, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.290882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.310126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1157/2311] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:06 2022] PUT /identity/v3/projects/5f4a18aee24d4fd3a7fdeeb18ef36a34/users/5aadd607eaef41b6b84b00a89d0a3ed2/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:06.322904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.323186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.323578 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.354770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] MFA Rules not processed for user `5aadd607eaef41b6b84b00a89d0a3ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:06.356261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:06.422311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:06.437707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1155/2312] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:06.445370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:06.447369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:06.532641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28673c-ceca-4ecc-99f9-d692062678b6 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:06.538198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:06.538803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:06.539081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:06.539351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:06.547629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:06.549871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce778af-0e79-4d5e-88d7-79e2282b618e service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:06.560104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1158/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:15.512421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:15.514393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:15.598159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955ff7-f472-4a4a-af12-bbf2d2712835 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:15.603161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:15.603890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:15.604228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:15.604526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] PATH_INFO: `/v3/users/e008ef296d7d4458bf44a8c329ce3b87` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:15.605753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e008ef296d7d4458bf44a8c329ce3b87)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:15.607727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:15.666866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e008ef296d7d4458bf44a8c329ce3b87'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:15.681408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e008ef296d7d4458bf44a8c329ce3b87'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:15.682534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e008ef296d7d4458bf44a8c329ce3b87'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:15.691630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e008ef296d7d4458bf44a8c329ce3b87'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:15.692689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e008ef296d7d4458bf44a8c329ce3b87'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:15.708619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1156/2314] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:15 2022] DELETE /identity/v3/users/e008ef296d7d4458bf44a8c329ce3b87 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:15.713221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:15.714215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:15.714489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:15.722182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:15.742809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:15.744466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:15.820179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1159/2315] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:15.830715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:15.832803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:15.894856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7cca-1524-4ae7-b54e-037fa75be88e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:15.898567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:15.899182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:15.899438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:15.899736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:15.909358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:15.910772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:15.920839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1157/2316] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:16.193731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:16.195172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.208097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee12cb3-3faf-40a9-84a2-67da2498556b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:16.212739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:16.213374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.213649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.213918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] PATH_INFO: `/v3/projects/588ad265063647979ead36353d3d8922` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.215028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588ad265063647979ead36353d3d8922)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:16.216964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:16.263823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588ad265063647979ead36353d3d8922', 'request_id': 'req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.269500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588ad265063647979ead36353d3d8922', 'request_id': 'req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.276517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588ad265063647979ead36353d3d8922', 'request_id': 'req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.287360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] The token cache is being invalidate because project 588ad265063647979ead36353d3d8922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:16.287675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.288298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.289761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1160/2317] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:16 2022] DELETE /identity/v3/projects/588ad265063647979ead36353d3d8922 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:16.293776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:16.304167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166e967-56c2-45ff-83a1-53481d9987bc service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:16.317083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:16.361140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:16.361757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.362030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.362308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] PATH_INFO: `/v3/users/52eb0f5e6b9a4a8c863c7466c23fdfa0` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.363406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52eb0f5e6b9a4a8c863c7466c23fdfa0)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:16.365374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:16.417017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52eb0f5e6b9a4a8c863c7466c23fdfa0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.429817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52eb0f5e6b9a4a8c863c7466c23fdfa0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.430501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52eb0f5e6b9a4a8c863c7466c23fdfa0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.439819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52eb0f5e6b9a4a8c863c7466c23fdfa0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.440717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52eb0f5e6b9a4a8c863c7466c23fdfa0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.452930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1158/2318] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:16 2022] DELETE /identity/v3/users/52eb0f5e6b9a4a8c863c7466c23fdfa0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:16.617072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:16.618699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.632617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ba4f-f5c4-4f56-9f6b-dc12294650d4 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:16.698315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:16.698951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.699226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.699494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] PATH_INFO: `/v3/users/49e4fecfe40549f5a3a9d3c0ceb1c7af` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.700637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e4fecfe40549f5a3a9d3c0ceb1c7af)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:16.702536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:16.732542 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:16.734137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.734760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:16.749552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64008651-3f9e-4d05-8d06-fec7f8bcce41 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:16.756051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:16.756720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.756998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.757322 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] PATH_INFO: `/v3/projects/be82ff6646cc4500bb34c31cbc704b6b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.758504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=be82ff6646cc4500bb34c31cbc704b6b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:16.760438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:16.774058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e4fecfe40549f5a3a9d3c0ceb1c7af'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.789336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e4fecfe40549f5a3a9d3c0ceb1c7af'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.799503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e4fecfe40549f5a3a9d3c0ceb1c7af'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.800266 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e4fecfe40549f5a3a9d3c0ceb1c7af'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.811842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-57654063-a7fd-44e9-9897-f1bb2f8c6570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e4fecfe40549f5a3a9d3c0ceb1c7af'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.812743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be82ff6646cc4500bb34c31cbc704b6b', 'request_id': 'req-85053d1e-4fa5-4034-9834-9f2811f225ca'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.818272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1161/2319] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:16 2022] DELETE /identity/v3/users/49e4fecfe40549f5a3a9d3c0ceb1c7af => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:16.819780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be82ff6646cc4500bb34c31cbc704b6b', 'request_id': 'req-85053d1e-4fa5-4034-9834-9f2811f225ca'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.823579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.824122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.824612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.828303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be82ff6646cc4500bb34c31cbc704b6b', 'request_id': 'req-85053d1e-4fa5-4034-9834-9f2811f225ca'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.841834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] The token cache is being invalidate because project be82ff6646cc4500bb34c31cbc704b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:16.842113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.842743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-85053d1e-4fa5-4034-9834-9f2811f225ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:16.844546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1159/2320] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:16 2022] DELETE /identity/v3/projects/be82ff6646cc4500bb34c31cbc704b6b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:16.849800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87e2c-94f6-44c3-8f9b-a421942eb440 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.850085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87e2c-94f6-44c3-8f9b-a421942eb440 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.850210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:16.850378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87e2c-94f6-44c3-8f9b-a421942eb440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.851798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.876287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cfd87e2c-94f6-44c3-8f9b-a421942eb440 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:16.877556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfd87e2c-94f6-44c3-8f9b-a421942eb440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.905954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:16.924944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1162/2321] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:16.939127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:16.940505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:16.963830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1160/2322] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:16.972617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:16.973064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:16.973343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:16.992503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:16.993705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.001329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e6bf-19c0-4b60-b2f9-47b8470befbf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.002700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1161/2323] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:17.005206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.005815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.006091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.006361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.006772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.015506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.017325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb7a9d-d3dd-45a9-8795-a6e9c73744aa None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.017566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.021906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.022487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.022896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.023035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.023711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:17.024020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.025627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.028523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1163/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:17.037787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1162/2325] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:39:17.042188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.051737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45b7d4-2339-4cc0-9a1b-c21a7d432656 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.056572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.057165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.057439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.057714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.058335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.060263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.092325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1164/2326] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:17.093812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.105088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754506-7744-47a6-8c55-e43e94f5d85f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.164637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.165237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.165511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.165780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.166407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.168337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.198448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1163/2327] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:17.199612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.211103 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608759-4490-474d-b3bc-a91c3f6bd49b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.215892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.216432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.216708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.216978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.217623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.219217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.229962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1165/2328] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:17.234182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.244421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114b40-27d6-4ef3-be85-e7fadc6b71b8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.249038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.249630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.249906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.250178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.250806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.252970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.267417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1164/2329] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:17.268646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.279263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325c25-4226-4f7e-b9f7-2e1587c4f26a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.283953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.284605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.284911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.285178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] PATH_INFO: `/v3/projects/08ccc5a670c049eda6e6f5b97b73ebec/users/73ea9b3af8884377888513b608669afa/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.297312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:17.301120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ccc5a670c049eda6e6f5b97b73ebec, user_id=73ea9b3af8884377888513b608669afa, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.304716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc6f63-024f-4869-b23d-c2f254ae41c7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.312967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.315899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.332104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1166/2330] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:17 2022] PUT /identity/v3/projects/08ccc5a670c049eda6e6f5b97b73ebec/users/73ea9b3af8884377888513b608669afa/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:17.335568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f5dc7-9525-42f6-9150-bfbcb20c8ee4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.337079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.337369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.337646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.357328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:17.358516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.394083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.394712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.395043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.395319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] PATH_INFO: `/v3/projects/0d438b7302cd4a2cb101ce4b5574994a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.396510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d438b7302cd4a2cb101ce4b5574994a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.398440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.419160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1167/2331] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:17.422212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:17.430408 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.431908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.449408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d438b7302cd4a2cb101ce4b5574994a', 'request_id': 'req-c6df3e75-af14-45a1-b719-976f4af702a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:17.460523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d438b7302cd4a2cb101ce4b5574994a', 'request_id': 'req-c6df3e75-af14-45a1-b719-976f4af702a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:17.470197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d438b7302cd4a2cb101ce4b5574994a', 'request_id': 'req-c6df3e75-af14-45a1-b719-976f4af702a9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:17.483227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] The token cache is being invalidate because project 0d438b7302cd4a2cb101ce4b5574994a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:17.483561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:17.484231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c6df3e75-af14-45a1-b719-976f4af702a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:17.485730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1165/2332] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:17 2022] DELETE /identity/v3/projects/0d438b7302cd4a2cb101ce4b5574994a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:17.490374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449604-4be1-4495-9228-d796d5d9d72b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.490657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449604-4be1-4495-9228-d796d5d9d72b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.490929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449604-4be1-4495-9228-d796d5d9d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.510755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-08449604-4be1-4495-9228-d796d5d9d72b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:17.511985 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-08449604-4be1-4495-9228-d796d5d9d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.512803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e0c1-a7e3-4473-ad6f-40f55283849a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.561542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.562157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.562441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.562712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.565166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.570728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1166/2333] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:17.577107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.578035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.578319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.578576 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.578681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.589098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1168/2334] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:39:17.599502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:17.600861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:17.612017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1167/2335] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:17.616123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.626788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13739-a08c-4f84-bd8d-a1d7c52edf5a service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.631451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.632284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.632567 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.632839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.633478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:17.633779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.635390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.646967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1169/2336] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:17.651345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.661071 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a6e7c-04bd-4c52-9bb6-48bdb44fd1fd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.666945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.667673 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.668049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.668323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.668947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.671024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.709374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1168/2337] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:17.713851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.724188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464413b3-f02a-42e6-8d94-34aff0e6ceea admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.762441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:17.788462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.789111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.789369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.789633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.790260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.792208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.815531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1170/2338] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:17.819450 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.830300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577873c-0f17-404f-9d76-b224cdc4a49a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.835824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.836435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.836715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.837131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.837625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.839534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.853761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1169/2339] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:17.855036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.867256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32e32-eade-4c86-9cf3-5170fb4ce51a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.872120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.872735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.873017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.873292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.873940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.875572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985bb7f-8d1e-4bac-9ed4-07fb6c24029b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.889442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1171/2340] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:17.890896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:17.901046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b1601-e8b7-4bf7-85aa-3bfd8cf42e30 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:17.906388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:17.907037 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.907351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.907689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] PATH_INFO: `/v3/projects/8c0e70db84d64777af111825ff71df8c/users/954309a32da947518f8ad201dfa51ccb/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.924474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0e70db84d64777af111825ff71df8c, user_id=954309a32da947518f8ad201dfa51ccb, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:17.927241 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:17.943599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1170/2341] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:17 2022] PUT /identity/v3/projects/8c0e70db84d64777af111825ff71df8c/users/954309a32da947518f8ad201dfa51ccb/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:17.947905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:17.948191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:17.948489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:17.974130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:17.975723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:18.093914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1172/2342] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:18.107101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:18.109320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:18.166193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:18.172054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bdd5-adee-47d0-9462-8e27b84697c9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:18.179415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:18.180126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:18.180417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:18.181038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:18.191686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:18.193124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a88a3-7836-4056-a78d-53577bb541be service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:18.203572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1171/2343] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:22.198412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:22.200423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:22.226407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d599-6c4c-4aba-923a-2eb2439dbe14 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:22.246961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:22.247648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:22.247934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:22.248208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] PATH_INFO: `/v3/users/61614acde27844788d9f6ce14cbddc1d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:22.250969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=61614acde27844788d9f6ce14cbddc1d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:22.253216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:22.374912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61614acde27844788d9f6ce14cbddc1d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:22.417503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61614acde27844788d9f6ce14cbddc1d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:22.445480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61614acde27844788d9f6ce14cbddc1d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:22.446125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61614acde27844788d9f6ce14cbddc1d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:22.469652 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61614acde27844788d9f6ce14cbddc1d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:22.480790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1173/2344] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:22 2022] DELETE /identity/v3/users/61614acde27844788d9f6ce14cbddc1d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:22.483186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:22.483734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:22.483831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:22.514034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:22.516343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:22.663148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1172/2345] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:22.703483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:22.707534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:22.787752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:22.814622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:22.815645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:22.847961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbc65b-e0aa-439b-bda9-4097f7db3dbd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:22.882922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:22.883679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:22.883963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:22.884233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] PATH_INFO: `/v3/users/5aadd607eaef41b6b84b00a89d0a3ed2` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:22.886960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aadd607eaef41b6b84b00a89d0a3ed2)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:22.888896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:22.895194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa013-fe72-49a3-a469-2be1b06188ae admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:22.906526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:22.911481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:22.911806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:22.912084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:22.949407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:22.951326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f53947-659b-44e2-a439-5100511014de service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:22.980440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1174/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:23.041487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aadd607eaef41b6b84b00a89d0a3ed2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.065525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aadd607eaef41b6b84b00a89d0a3ed2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.066726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aadd607eaef41b6b84b00a89d0a3ed2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.100126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aadd607eaef41b6b84b00a89d0a3ed2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.103968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aadd607eaef41b6b84b00a89d0a3ed2'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.148660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:23.148948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:23.149236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:23.152182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1173/2347] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:22 2022] DELETE /identity/v3/users/5aadd607eaef41b6b84b00a89d0a3ed2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:23.178132 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:23.181373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:23.283229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1175/2348] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:23.324140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:23.325637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:23.477958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:23.479715 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:23.487196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a96241-36db-428a-9ebf-ea59bc21a928 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:23.496415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:23.497527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:23.498098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:23.498928 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:23.505843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adb80a-6249-45cf-95a6-abcecb03902d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:23.524298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:23.524522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:23.532921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:23.533512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:23.534884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] PATH_INFO: `/v3/users/53580fb7acc1425f86eb5342fdea19b8` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:23.537930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53580fb7acc1425f86eb5342fdea19b8)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:23.538959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aebe7e-2151-4f76-8217-0b99ef654b86 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:23.544017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:23.563803 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1174/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:23.680068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53580fb7acc1425f86eb5342fdea19b8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.715920 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53580fb7acc1425f86eb5342fdea19b8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.735340 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53580fb7acc1425f86eb5342fdea19b8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.736191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53580fb7acc1425f86eb5342fdea19b8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.757928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53580fb7acc1425f86eb5342fdea19b8'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:23.774859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1176/2350] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:23 2022] DELETE /identity/v3/users/53580fb7acc1425f86eb5342fdea19b8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:23.780077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:23.780360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:23.780632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:23.799295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:23.837645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:23.839058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:24.053500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1175/2351] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:24.126746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:24.128615 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:24.263726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:24.291292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25b280-cc14-4d15-a070-4af2fb094d2d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:24.301901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:24.302535 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:24.302812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:24.303083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:24.337079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:24.339454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:24.371152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1177/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:24.607733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:24.609287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:24.632827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3ab3d-fc64-4870-a0df-b5b34e46e1bd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:24.654642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:24.655336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:24.655634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:24.655910 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] PATH_INFO: `/v3/projects/d55b918b6a28499299cded2394b79cfb` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:24.657680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55b918b6a28499299cded2394b79cfb)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:24.659688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:24.777683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55b918b6a28499299cded2394b79cfb', 'request_id': 'req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:24.798149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55b918b6a28499299cded2394b79cfb', 'request_id': 'req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:24.821244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55b918b6a28499299cded2394b79cfb', 'request_id': 'req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:24.840261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] The token cache is being invalidate because project d55b918b6a28499299cded2394b79cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:24.841429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:24.848870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ad8ea44-1fa8-4fc6-abbf-03fba5a725d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:24.852754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1176/2353] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:24 2022] DELETE /identity/v3/projects/d55b918b6a28499299cded2394b79cfb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:25.240963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:25.242414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.268826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971df48-7761-43c3-8ace-54f85a50ba69 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:25.388107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:25.389454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.390640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.391086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] PATH_INFO: `/v3/projects/5f4a18aee24d4fd3a7fdeeb18ef36a34` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.412606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4a18aee24d4fd3a7fdeeb18ef36a34)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:25.414581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:25.475907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.476506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.476949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.540193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4a18aee24d4fd3a7fdeeb18ef36a34', 'request_id': 'req-6137b172-6715-41aa-85f0-35e4f05ec7e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.543923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] MFA Rules not processed for user `73ea9b3af8884377888513b608669afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:25.545258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.557489 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4a18aee24d4fd3a7fdeeb18ef36a34', 'request_id': 'req-6137b172-6715-41aa-85f0-35e4f05ec7e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.579456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4a18aee24d4fd3a7fdeeb18ef36a34', 'request_id': 'req-6137b172-6715-41aa-85f0-35e4f05ec7e0'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.612538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] The token cache is being invalidate because project 5f4a18aee24d4fd3a7fdeeb18ef36a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:25.612843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.613565 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6137b172-6715-41aa-85f0-35e4f05ec7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.615111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1178/2354] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:25 2022] DELETE /identity/v3/projects/5f4a18aee24d4fd3a7fdeeb18ef36a34 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:25.622255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6f99-4024-40c5-a296-7fb3e83e8b86 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.622460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6f99-4024-40c5-a296-7fb3e83e8b86 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.622673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6f99-4024-40c5-a296-7fb3e83e8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.655984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-13bd6f99-4024-40c5-a296-7fb3e83e8b86 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:25.658039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-13bd6f99-4024-40c5-a296-7fb3e83e8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.684331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1177/2355] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:25.689330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:25.691146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.740311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:25.745353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1179/2356] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:25.757929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.758693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.759442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.808044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:25.809504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.820570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1180/2357] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:25.824677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:25.827291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:25.833487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff09635-39a4-4d43-a914-1284c8b362f5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:25.841211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:25.842142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.842298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.842764 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02ac0-d724-4e15-9c4f-f0e09fdfe8d1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:25.842887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.845382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:25.849439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:25.849828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:25.850651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:25.851213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:25.851671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] PATH_INFO: `/v3/projects/947aca5fa7374fbba60ca3229929171a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:25.853000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] RBAC: Authorizing `identity:delete_project(project_id=947aca5fa7374fbba60ca3229929171a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:25.855294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:25.864812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:25.896966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1178/2358] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:25.898121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:25.936421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947aca5fa7374fbba60ca3229929171a', 'request_id': 'req-b20783ed-5577-49b8-b036-f9235d9f24db'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.951749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947aca5fa7374fbba60ca3229929171a', 'request_id': 'req-b20783ed-5577-49b8-b036-f9235d9f24db'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.965185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947aca5fa7374fbba60ca3229929171a', 'request_id': 'req-b20783ed-5577-49b8-b036-f9235d9f24db'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.988683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] The token cache is being invalidate because project 947aca5fa7374fbba60ca3229929171a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:25.988986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.989705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:25.992239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1181/2359] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:25 2022] DELETE /identity/v3/projects/947aca5fa7374fbba60ca3229929171a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:25.993068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:25.994432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.040394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627d35-6201-4dd4-a605-e86b46788893 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.144940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.145577 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.145856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.146125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.146829 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:26.147134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.153108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbf14d-c60d-4bb1-ba04-05ee2553df06 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.169666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1179/2360] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:26.175114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.175593 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.175853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.189301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20783ed-5577-49b8-b036-f9235d9f24db admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.202828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:26.204903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.206689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.207674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.208025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.208710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.209076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.212918 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf051206-f44b-4b88-9561-e8fffe383841 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.227561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1180/2361] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:26.228936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.231329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.251098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1182/2362] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:25 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:26.252435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.252757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.253041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.255871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ed1b-e568-485a-b003-d7fed4a92706 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.262715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.263633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.264247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.264725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.265375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.270310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.277997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:26.280240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.297777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1183/2363] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:26.299016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.311839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cee5-d53e-405c-a1df-9c34b193afa0 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.318878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1181/2364] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:26.320100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.342115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:26.431599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.432347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.432723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.433089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.434270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.436210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.456076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1184/2365] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:26.456934 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.466479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a390-3203-44e9-8738-743fe25a35e3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.472797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.473013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368c3e-de15-405b-9a51-bb9561f2cf47 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.473565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.474135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.474531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.475342 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:26.475685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.477387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218576e1-c055-4692-b7cf-a9c95f1c3720 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.479123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.480472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.480865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.481146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.481782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.487194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.490556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1182/2366] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:26.492479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.492770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.493048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.499609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:26.524301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1185/2367] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/users => generated 284 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:26.525351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.531651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] MFA Rules not processed for user `954309a32da947518f8ad201dfa51ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:26.533446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.542001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e545-3bed-47a2-8078-543c000daa28 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.550515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.551212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.551735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.552023 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] PATH_INFO: `/v3/projects/71025fdcfbd442208b12121c25c645aa/users/bec2445085a84c49a38628d7e6b6fade/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.578515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71025fdcfbd442208b12121c25c645aa, user_id=bec2445085a84c49a38628d7e6b6fade, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.587650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.619002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1186/2368] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:26 2022] PUT /identity/v3/projects/71025fdcfbd442208b12121c25c645aa/users/bec2445085a84c49a38628d7e6b6fade/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:26.621017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.661533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1183/2369] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:26.670780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.686066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e684b0-fe70-4c2d-9f4c-67089f918033 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.757345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.757966 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.758246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.758518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.759169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.761174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.770284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f755dd6-3298-4960-a29f-6762c9fc0089 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.772628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1184/2370] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:26.773647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.784267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.785123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.785602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f46e80-3919-4e2f-99ac-53e169ab28f4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.785880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.786339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.787124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.791208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.791922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.792655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.793164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.793572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.794233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.797103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.812079 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1185/2371] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:26.813149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.816017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:26.836457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870dc55-2383-433f-873a-acdf76b658d5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:26.845276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:26.846428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:26.846755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:26.847039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:26.847888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:26.852011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:26.861589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1187/2372] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:26.862640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.912411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1186/2373] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:26 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:26.916108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:26.929439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:27.021932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9594e3-dd99-4662-bada-916d234b7055 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.027107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40009f-6620-42df-b4d2-976a6a5eaf2c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.030285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.030968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.031251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.031533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] PATH_INFO: `/v3/projects/71025fdcfbd442208b12121c25c645aa/users/bec2445085a84c49a38628d7e6b6fade/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.033042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.033921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.034213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.035180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=71025fdcfbd442208b12121c25c645aa, user_id=bec2445085a84c49a38628d7e6b6fade, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.035682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.036358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.037958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.038650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.050254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1188/2374] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:27.051118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.052428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1187/2375] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:26 2022] PUT /identity/v3/projects/71025fdcfbd442208b12121c25c645aa/users/bec2445085a84c49a38628d7e6b6fade/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:27.053723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.062642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd742b-972f-4cf2-85db-0f34a7cb67cb admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.122484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:27.137465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.138402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.138707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.139052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.139849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.141576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a9dc-ba79-4a3f-9c03-02c8a4306ccd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.142292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.147943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.149124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.149124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.149440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.150224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.152640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.174247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1189/2376] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:27 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:27.174247 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.191064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1188/2377] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:27 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:27.192063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.198969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1571196-91e1-47a9-8e79-1c7c10b58305 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.205192 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab584d1-80ec-40f3-b81d-2ddc9e528d1a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.206846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.208098 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.208429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.208707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] PATH_INFO: `/v3/projects/fa68028d3a6f47ea921ef75d3eb16d11/users/81bfc3b29fa44c16990c31ecde56427c/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.216063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.216696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.216981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.221253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.222850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.224565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.237165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa68028d3a6f47ea921ef75d3eb16d11, user_id=81bfc3b29fa44c16990c31ecde56427c, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.240763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.252482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1189/2378] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:27.256423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.260676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1190/2379] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:27 2022] PUT /identity/v3/projects/fa68028d3a6f47ea921ef75d3eb16d11/users/81bfc3b29fa44c16990c31ecde56427c/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:27.261313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.297028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed836371-b493-4675-a553-7a888cdadfd8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.379206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4da9da-fcdd-4034-99c9-e0bf7d22198f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.384953 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.387086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.387364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.387827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.388494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.390276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef837da6-dd17-40c6-8592-b3870d0eded9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.407552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1191/2380] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:27.409047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.409328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.410169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.458491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] MFA Rules not processed for user `81bfc3b29fa44c16990c31ecde56427c`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:27.460862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:27.461093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.463035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.463860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.465174 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.466070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.471266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.483046 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1190/2381] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:27.484599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.496554 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4462dc-d288-40ee-a8ee-3d1f16faf955 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.503094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.504339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.513558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.514569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] PATH_INFO: `/v3/projects/05357a8e35f54e6691cef114e58d3f8f/users/e2c2a51f04e14db280df83e5145d3584/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.528942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:27.538671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05357a8e35f54e6691cef114e58d3f8f, user_id=e2c2a51f04e14db280df83e5145d3584, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.542772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.552871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1192/2382] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:27.554899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.570112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289b19b-bbb6-4b3c-90fa-632882c33fed None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.571841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1191/2383] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:27 2022] PUT /identity/v3/projects/05357a8e35f54e6691cef114e58d3f8f/users/e2c2a51f04e14db280df83e5145d3584/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:27.575521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:27.582798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:27.666363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:27.694473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.695484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.696324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.696822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] PATH_INFO: `/v3/projects/604aeb060e9f4407900dd86f522c2bc1/users/891c88ffdb204d468a839e57671b0736/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.762179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798d05d-14ed-494d-b623-ba7286dcf136 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:27.768640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:27.769333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.769615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.769992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:27.905682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:27.909819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0fc86-ab54-4113-a6c6-7ab8cd008375 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:27.939517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1192/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:27.941713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:27.944340 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:27.944950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:28.000269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] MFA Rules not processed for user `e2c2a51f04e14db280df83e5145d3584`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:28.001810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] RBAC: Authorizing `identity:create_grant(project_id=604aeb060e9f4407900dd86f522c2bc1, user_id=891c88ffdb204d468a839e57671b0736, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:28.002038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:28.020377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:28.057831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1193/2385] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:27 2022] PUT /identity/v3/projects/604aeb060e9f4407900dd86f522c2bc1/users/891c88ffdb204d468a839e57671b0736/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:28.061790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:28.108623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1193/2386] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:28.120963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:28.123102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:28.146580 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872042-56f9-4736-81d4-cfaba3db1111 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:28.211888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:28.258225 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:28.258971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:28.259312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:28.259683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:28.281996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e682f9-69ca-4cf3-9083-2e81ea43835f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:28.298512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:28.298787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:28.298885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:28.301432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:28.303942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:28.305394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:28.351638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1194/2387] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:28.353245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:28.401600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f5aa0-e031-47c9-8f60-fad67641bedf admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:28.426802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:28.428763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:28.429269 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:28.429590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] PATH_INFO: `/v3/projects/604aeb060e9f4407900dd86f522c2bc1/users/891c88ffdb204d468a839e57671b0736/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:28.432046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604aeb060e9f4407900dd86f522c2bc1, user_id=891c88ffdb204d468a839e57671b0736, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:28.440983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:28.442108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefe4a-c466-4958-93ef-e72a3ab884d7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:28.444184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:28.463783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1195/2388] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:28 2022] PUT /identity/v3/projects/604aeb060e9f4407900dd86f522c2bc1/users/891c88ffdb204d468a839e57671b0736/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:28.464301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1194/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:35.286156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17722d-15b8-49d6-ab8c-6ab40e30233d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:35.286612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17722d-15b8-49d6-ab8c-6ab40e30233d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:35.286719 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17722d-15b8-49d6-ab8c-6ab40e30233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:35.323298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0a17722d-15b8-49d6-ab8c-6ab40e30233d None None] MFA Rules not processed for user `bec2445085a84c49a38628d7e6b6fade`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:35.325623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0a17722d-15b8-49d6-ab8c-6ab40e30233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:35.496927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1196/2390] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:35.497473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:35.499146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:35.702379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378baa7-7949-4aea-b3e6-90ec72cefb63 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:35.814678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:35.815299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:35.815630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:35.816246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:35.818547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:35.856366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:35.906885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:35.908265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:35.930884 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1195/2391] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:39:36.024318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569053e-e022-4652-ad26-7455c3b7585f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:36.024533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569053e-e022-4652-ad26-7455c3b7585f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:36.024803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569053e-e022-4652-ad26-7455c3b7585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:36.096256 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0569053e-e022-4652-ad26-7455c3b7585f None None] MFA Rules not processed for user `891c88ffdb204d468a839e57671b0736`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:36.099362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0569053e-e022-4652-ad26-7455c3b7585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:36.199015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:36.329787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1197/2392] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:36.345534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:36.347504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:36.494015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d99e-e19b-43c2-a7da-bc8ed1efbcaa service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:36.499144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:36.499795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:36.500926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:36.501351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:36.673384 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:36.682880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:36.729147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1196/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:37.030494 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:37.030854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:37.031245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:37.062735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:37.064031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:37.145008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1198/2394] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:37.193738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:37.195497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:37.303586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c129e-fbc0-4440-96ab-5de7a26df699 service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:37.308707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:37.309518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:37.309759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:37.309853 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:37.323448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:37.325058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10855c-cfc9-4efd-ac01-202013979d2e service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:37.335585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1197/2395] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:37.497984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:37.590107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84214c-0dda-4791-9e78-3f25b8e49ccf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:37.605253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:37.606051 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:37.606336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:37.606605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] PATH_INFO: `/v3/users/e2c2a51f04e14db280df83e5145d3584` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:37.612642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c2a51f04e14db280df83e5145d3584)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:37.614844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:37.637658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c024f2-4ea7-45a2-b9d3-402bc7f926e0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:37.638115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c024f2-4ea7-45a2-b9d3-402bc7f926e0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:37.638209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c024f2-4ea7-45a2-b9d3-402bc7f926e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:37.649706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:37.662603 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-14c024f2-4ea7-45a2-b9d3-402bc7f926e0 None None] MFA Rules not processed for user `73ea9b3af8884377888513b608669afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:37.664052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-14c024f2-4ea7-45a2-b9d3-402bc7f926e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:37.672896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1198/2396] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:37.674413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c2a51f04e14db280df83e5145d3584'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:37.688106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c2a51f04e14db280df83e5145d3584'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:37.691126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:37.704505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c2a51f04e14db280df83e5145d3584'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:37.706122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c2a51f04e14db280df83e5145d3584'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:37.717097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c2a51f04e14db280df83e5145d3584'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:37.730856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1199/2397] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:37 2022] DELETE /identity/v3/users/e2c2a51f04e14db280df83e5145d3584 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:37.734958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:37.735243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:37.735709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:37.766611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:37.768508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:37.900175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1199/2398] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:37.915251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:37.917155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:38.054627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb768885-5f56-4c34-8559-2b603e17cc88 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:38.059629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:38.059629 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:38.061037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:38.061037 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:38.073146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:38.074787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf4bc3-f6e1-4d49-bf60-97e555880941 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:38.153338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1200/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:39.113130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:39.116842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:39.156690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0389-68bb-4c68-a919-d3f9e70fff9e None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:39.172392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:39.173457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:39.173925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:39.174923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] PATH_INFO: `/v3/projects/05357a8e35f54e6691cef114e58d3f8f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:39.176321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05357a8e35f54e6691cef114e58d3f8f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:39.180213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:39.301488 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05357a8e35f54e6691cef114e58d3f8f', 'request_id': 'req-daf2d3cb-cbff-4e41-a2a6-502371418c4f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:39.314338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05357a8e35f54e6691cef114e58d3f8f', 'request_id': 'req-daf2d3cb-cbff-4e41-a2a6-502371418c4f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:39.326857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05357a8e35f54e6691cef114e58d3f8f', 'request_id': 'req-daf2d3cb-cbff-4e41-a2a6-502371418c4f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:39.355843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] The token cache is being invalidate because project 05357a8e35f54e6691cef114e58d3f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:39.356727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:39.361166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-daf2d3cb-cbff-4e41-a2a6-502371418c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:39.369828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:39.370399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:39.370399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:39.375787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1200/2400] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:39 2022] DELETE /identity/v3/projects/05357a8e35f54e6691cef114e58d3f8f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:39.395922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:39.397805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:39.577630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1201/2401] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:39.586338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:39.586894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:39.587393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:39.673299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:39.676155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:39.705163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1201/2402] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:39.706541 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:39.720124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4a6e-4f3c-4454-98af-b195d8ad8968 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:39.727709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:39.729439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:39.730451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:39.731090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:39.734887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:39.736156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:39.739687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:39.758179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1202/2403] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:39.763793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:39.785654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be21ac-9240-4e48-b7b3-bc02df918a07 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:39.798621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:39.799451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:39.800855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:39.804076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:39.805065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:39.807310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:39.882651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1202/2404] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:39 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:39.886862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:39.909293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81bec5-a909-4b3d-a7e3-ba3299101aed admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:40.013336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:40.014282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.014661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.015035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.018845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:40.022464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:40.054076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1203/2405] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:39 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:40.055035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:40.067122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0e35-3531-4e65-ae68-c88d863e87ab admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:40.072380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:40.103138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.106390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.114409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.116480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:40.124017 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:40.161399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1203/2406] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:40.164944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:40.173120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:40.179491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00e570-81d8-4bc3-a35d-e05b736ced62 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:40.189523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:40.190341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.190514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.190763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.191416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:40.204717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aec84-98cd-4e2f-9640-17516c9d7b9a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:40.222910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1204/2407] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:40.227460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:40.239050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1195bc1-4390-42dc-9339-b0e8e51ea163 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:40.245398 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:40.246262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.247653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.248780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] PATH_INFO: `/v3/projects/1f5dabb4b29446b0979061b533b87121/users/335715159a894a93a4b6c2dad089ef8b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.272621 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5dabb4b29446b0979061b533b87121, user_id=335715159a894a93a4b6c2dad089ef8b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:40.275319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:40.294842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1204/2408] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:40 2022] PUT /identity/v3/projects/1f5dabb4b29446b0979061b533b87121/users/335715159a894a93a4b6c2dad089ef8b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:40.314476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.318843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.319218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.374061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] MFA Rules not processed for user `335715159a894a93a4b6c2dad089ef8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:40.376633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:40.453772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1205/2409] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:40.472464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:40.474638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:40.507895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:40.589069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264ebc-afbb-433e-b780-16c133c22ed0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:40.594551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:40.595471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:40.595816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:40.596314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:40.610376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:40.614422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abe09c-fa4f-4b3b-a264-812c1734590f service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:40.628721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1205/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:42.551220 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:42.553910 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:42.658174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2045-2af0-4f23-9b28-4c8cb7d3aa44 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:42.665284 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:42.666162 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:42.666594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:42.667016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] PATH_INFO: `/v3/users/81bfc3b29fa44c16990c31ecde56427c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:42.668420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bfc3b29fa44c16990c31ecde56427c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:42.670635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:42.744898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bfc3b29fa44c16990c31ecde56427c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:42.763690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bfc3b29fa44c16990c31ecde56427c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:42.772992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bfc3b29fa44c16990c31ecde56427c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:42.773788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bfc3b29fa44c16990c31ecde56427c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:42.783017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bfc3b29fa44c16990c31ecde56427c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:42.792678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1206/2411] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:42 2022] DELETE /identity/v3/users/81bfc3b29fa44c16990c31ecde56427c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:42.797918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:42.798404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:42.798795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:42.821182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:42.822672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:42.905698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1206/2412] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:42.912569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:42.913956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:42.921191 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:43.000093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513d85-e158-4341-848e-a5a61e30b1fa admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:43.006148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:43.006794 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:43.007072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:43.007347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:43.021263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:43.022741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f4bb-5274-4a17-8124-b43c9bb261a9 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:43.035134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1207/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:43.358709 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:43.368326 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:43.394245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1164bce-d2b7-46a4-aaf8-4d72741f7d31 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:43.416570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:43.417359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:43.417713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:43.418061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] PATH_INFO: `/v3/users/335715159a894a93a4b6c2dad089ef8b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:43.435251 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] RBAC: Authorizing `identity:delete_user(user_id=335715159a894a93a4b6c2dad089ef8b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:43.438162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:43.546090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335715159a894a93a4b6c2dad089ef8b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:43.573261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335715159a894a93a4b6c2dad089ef8b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:43.574541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335715159a894a93a4b6c2dad089ef8b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:43.586938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335715159a894a93a4b6c2dad089ef8b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:43.588098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335715159a894a93a4b6c2dad089ef8b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:43.604899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1207/2414] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:43 2022] DELETE /identity/v3/users/335715159a894a93a4b6c2dad089ef8b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:43.609085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:43.609591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:43.609956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:43.642377 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:43.644022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:43.790355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:43.792059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:43.809978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1208/2415] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:43.820422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:43.822315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:43.823359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9365-d12c-4848-9b2a-18fd2326095d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:43.839703 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:43.840495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:43.841091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:43.841376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] PATH_INFO: `/v3/projects/fa68028d3a6f47ea921ef75d3eb16d11` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:43.843311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa68028d3a6f47ea921ef75d3eb16d11)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:43.868933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:43.948526 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:43.988231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa68028d3a6f47ea921ef75d3eb16d11', 'request_id': 'req-264ef694-388f-43d5-b65f-68185f5017ce'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:44.005798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa68028d3a6f47ea921ef75d3eb16d11', 'request_id': 'req-264ef694-388f-43d5-b65f-68185f5017ce'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:44.012508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af5ce-a27d-47d6-bcda-afaaeb778926 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.021740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa68028d3a6f47ea921ef75d3eb16d11', 'request_id': 'req-264ef694-388f-43d5-b65f-68185f5017ce'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:44.044973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] The token cache is being invalidate because project fa68028d3a6f47ea921ef75d3eb16d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:44.045253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:44.047368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-264ef694-388f-43d5-b65f-68185f5017ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:44.050645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1208/2416] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:43 2022] DELETE /identity/v3/projects/fa68028d3a6f47ea921ef75d3eb16d11 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:44.057153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea188342-c435-4863-b53f-92d2f7fe8a26 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.057761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea188342-c435-4863-b53f-92d2f7fe8a26 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.058066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea188342-c435-4863-b53f-92d2f7fe8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.089306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.090020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.090144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ea188342-c435-4863-b53f-92d2f7fe8a26 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:44.090299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.090716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.091596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ea188342-c435-4863-b53f-92d2f7fe8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:44.093038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:44.119664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:44.215592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1209/2417] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:44.222355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.223842 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.224035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.224617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.224899 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.238484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1209/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:44.251630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:44.252867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:44.261810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1210/2419] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:44.265809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.279621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877543b2-d881-4303-9ab0-b92e359460a1 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.288776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.289411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.289687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.290441 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.290929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:44.291235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.292887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.309440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1210/2420] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:44.314318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.331325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88467-4c03-4319-a96f-83df482bb81f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.337747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.338586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.339020 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.339646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.340522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.342679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.396444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1211/2421] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:44 2022] POST /identity/v3/projects => generated 355 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:44.400274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.412889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2c17-9a95-4ead-bab4-d5a9cd7c0ab9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.560452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.561922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.561922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.562537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.563185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.565177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.650061 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1211/2422] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:44 2022] POST /identity/v3/users => generated 278 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:44.653845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.670383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b3bac-35e8-4978-b84c-9d41a3418b0b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.685964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.686907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.687503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.688141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.689304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.691210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.728931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1212/2423] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:44.729657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.745385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ff86d-daf1-49ac-bd0d-e5a1f08d4a9e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.760243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.760860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.761135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.761402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.762519 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.763669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.791058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1212/2424] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:44.795300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.810021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1827c-f2b1-40bf-8472-3b6ee39cfb48 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.836478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.838718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.839005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.839279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] PATH_INFO: `/v3/projects/dc0fcf8300e54a939b82672d55a8f261/users/42b12c1c10a64c85918a8c2255bc7e3a/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.852579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:44.854425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:44.884183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11981ce-a38d-4c0f-9251-d0785fd1aab3 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:44.900730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0fcf8300e54a939b82672d55a8f261, user_id=42b12c1c10a64c85918a8c2255bc7e3a, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.903390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f4e7e-46b4-47a2-96ca-7effd68268f1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.910236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:44.910943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.911330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.911623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] PATH_INFO: `/v3/projects/1f5dabb4b29446b0979061b533b87121` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:44.916346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5dabb4b29446b0979061b533b87121)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:44.918253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:44.966110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1213/2425] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:44 2022] PUT /identity/v3/projects/dc0fcf8300e54a939b82672d55a8f261/users/42b12c1c10a64c85918a8c2255bc7e3a/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:44.980784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:44.981065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:44.981338 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.050139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] MFA Rules not processed for user `42b12c1c10a64c85918a8c2255bc7e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:45.051559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:45.071578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5dabb4b29446b0979061b533b87121', 'request_id': 'req-a76876f3-a36f-4482-be97-699462f2e12c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:45.085914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5dabb4b29446b0979061b533b87121', 'request_id': 'req-a76876f3-a36f-4482-be97-699462f2e12c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:45.103276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5dabb4b29446b0979061b533b87121', 'request_id': 'req-a76876f3-a36f-4482-be97-699462f2e12c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:45.119908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:45.137156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] The token cache is being invalidate because project 1f5dabb4b29446b0979061b533b87121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:45.138259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:45.139218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a76876f3-a36f-4482-be97-699462f2e12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:45.142460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1213/2426] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:44 2022] DELETE /identity/v3/projects/1f5dabb4b29446b0979061b533b87121 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:45.148366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2102d-455c-4e14-85a6-154900a84211 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.150384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2102d-455c-4e14-85a6-154900a84211 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.150773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2102d-455c-4e14-85a6-154900a84211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.154288 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:45.198454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-92a2102d-455c-4e14-85a6-154900a84211 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:45.211293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-92a2102d-455c-4e14-85a6-154900a84211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:45.243599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1214/2427] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:45.244521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.250840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:45.304018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1214/2428] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:39:45.314019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.318813 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.319358 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.353790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:45.356153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:45.373113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1215/2429] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:45.374064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.386753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f89b4-303f-4ad1-8837-34e97e083f9a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.392445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.393118 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.393605 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.393887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.394740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:39:45.395427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.397826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.409179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cc6ce-0f64-4da6-8344-57948e701daf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.412107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1216/2430] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:39:45.415979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.416514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.416651 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.419965 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.420831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.421502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.424968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.428264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044b09-4b99-4a38-a27d-2f2a6a2ebd4d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.434009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.434624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.434905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.435177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.436071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.439038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.465467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1215/2431] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/projects => generated 357 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:45.469650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.518234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1217/2432] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:39:45.522763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.619659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62676f-cca1-4124-a95a-45cc6ad29930 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.664514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdda291-db18-4e6e-91b6-ef5844ea4e2a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.672590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.673224 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.673506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.673784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.674810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.680506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.721800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1218/2433] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:45.722944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.757227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291613a-2bc5-4038-9e29-429b50b09b81 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.769393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.770732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.771013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.771298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.772229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.775588 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.786641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.787322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.787639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.787914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.794804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.796276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.816800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1216/2434] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:39:45 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:39:45.820166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.835281 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544b4f-6210-4e8e-852a-a6df80f85c2f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.836769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:45.845075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1219/2435] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:45.849041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.860935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.863782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.865495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.866238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.867243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.869106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12392ba9-6cf6-44d9-b4f2-a40da27e9870 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.870235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.881656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.882113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.882395 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.882671 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.883319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:45.884987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:45.895168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1217/2436] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:45.912650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:45.944165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9fe85-f4f1-4714-b50b-daa8b6817ab1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:45.976120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:45.977117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:45.977515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:45.983161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] PATH_INFO: `/v3/projects/ae4a31c5238149c78e12824e3c95116a/users/3f440e3b1dc8471b8c4729c70a99f011/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:45.989002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1220/2437] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:39:45.994497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:46.028234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62591d-8c7e-4806-91d7-6b92f4108e29 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:46.062160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:46.063187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.063785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.064238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] PATH_INFO: `/v3/projects/80ff2ace5f7743679570b095ca58917d/users/7014fcb70467444f9655bf34dcdf99ba/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.113478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ff2ace5f7743679570b095ca58917d, user_id=7014fcb70467444f9655bf34dcdf99ba, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:46.118141 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea25fd-aea5-4014-a889-2894f222a258 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:46.157370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4a31c5238149c78e12824e3c95116a, user_id=3f440e3b1dc8471b8c4729c70a99f011, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:46.159013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1221/2438] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:45 2022] PUT /identity/v3/projects/80ff2ace5f7743679570b095ca58917d/users/7014fcb70467444f9655bf34dcdf99ba/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:39:46.160998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:46.171383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.171864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.172153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.183160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1218/2439] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:45 2022] PUT /identity/v3/projects/ae4a31c5238149c78e12824e3c95116a/users/3f440e3b1dc8471b8c4729c70a99f011/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:46.190135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:46.195080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:46.255578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] MFA Rules not processed for user `7014fcb70467444f9655bf34dcdf99ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:46.256876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:46.433449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1222/2440] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:46.454016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:46.455723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:46.521555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f560-94b6-4dc0-982c-19cc182f4375 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:46.561348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:46.562852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.563300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.563863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.570498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:46.575999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:46.595784 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6254d-b898-4e7a-88ec-9ca261915da6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:46.607336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:46.608025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.608403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.608591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.626972 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:46.627987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b8a1-ebcd-4781-ae68-9a245537fef8 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:46.636201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1219/2441] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:39:46.644366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:46.656691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1223/2442] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:46.684064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a253f-1527-4b87-bce6-a4676f27a2e8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:46.695773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:46.696459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.696735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.697004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] PATH_INFO: `/v3/projects/ae4a31c5238149c78e12824e3c95116a/users/3f440e3b1dc8471b8c4729c70a99f011/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.699267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4a31c5238149c78e12824e3c95116a, user_id=3f440e3b1dc8471b8c4729c70a99f011, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:46.703449 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:46.752744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:46.753264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:46.753354 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:46.755487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1220/2443] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:39:46 2022] PUT /identity/v3/projects/ae4a31c5238149c78e12824e3c95116a/users/3f440e3b1dc8471b8c4729c70a99f011/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:46.838335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] MFA Rules not processed for user `3f440e3b1dc8471b8c4729c70a99f011`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:46.839716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:46.987119 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1224/2444] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:47.104269 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:47.238620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24867-0323-4610-8e69-c10d5868bb99 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:47.243452 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:47.244075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:47.244415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:47.244766 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:47.256519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:47.266207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1b6ee-46a5-4b6d-89c1-fc8a988c32ea service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:47.280443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1221/2445] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:47.669275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:47.695919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5bd8-dd15-406d-8ffb-38b294d9c866 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:47.714945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:47.718515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:47.719028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:47.719591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:47.749173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:47.829467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:47.834914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712dfb-5cb9-4393-a8f3-258f2825e3e5 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:47.873243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1225/2446] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:52.024626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:52.025280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:52.025280 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:52.057023 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] MFA Rules not processed for user `954309a32da947518f8ad201dfa51ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:52.058327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:52.134871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:52.155048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1222/2447] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:54.994305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:54.994834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:54.994926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:55.054901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:55.057112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:55.188473 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1226/2448] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:55.203190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:55.205363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:55.318599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75d9b7-27d3-465b-917b-2c7c7142567c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:55.326257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:55.326967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:55.328589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:55.328876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:55.340176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:55.341810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa0a7e-90de-4b39-a56f-8c20d9f32836 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:55.352983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1223/2449] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:58.307011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:58.420145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43e212-5a4e-47a7-8037-deee539f5f74 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:58.425556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:58.426476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:58.426922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:58.427357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] PATH_INFO: `/v3/users/7014fcb70467444f9655bf34dcdf99ba` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:58.428748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7014fcb70467444f9655bf34dcdf99ba)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:58.431446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:58.548491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7014fcb70467444f9655bf34dcdf99ba'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:58.579281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7014fcb70467444f9655bf34dcdf99ba'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:58.581244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:58.600115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7014fcb70467444f9655bf34dcdf99ba'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:58.600749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7014fcb70467444f9655bf34dcdf99ba'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:58.617233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7014fcb70467444f9655bf34dcdf99ba'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:58.626012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1227/2450] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:39:58 2022] DELETE /identity/v3/users/7014fcb70467444f9655bf34dcdf99ba => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:58.636038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:58.636038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:58.636038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:58.694170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:39:58.695816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:58.838706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1224/2451] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:39:58.856640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:58.859282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:59.036898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c74c5-06ed-4154-9b35-3e7a65ddd60d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:59.047343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:59.049913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:59.050199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:59.050542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:59.074748 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:59.076355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34647210-628e-4f5d-a0bc-553be2421f6e service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:59.101197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1228/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:39:59.786849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:39:59.789459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:39:59.846221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67d7c0-087c-4bf1-8d4e-74d1137b8775 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:39:59.852626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:39:59.853282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:59.853562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:59.854033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] PATH_INFO: `/v3/projects/80ff2ace5f7743679570b095ca58917d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:39:59.855630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ff2ace5f7743679570b095ca58917d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:39:59.857571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:39:59.942665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ff2ace5f7743679570b095ca58917d', 'request_id': 'req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:59.949056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ff2ace5f7743679570b095ca58917d', 'request_id': 'req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:59.959047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ff2ace5f7743679570b095ca58917d', 'request_id': 'req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:59.977933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] The token cache is being invalidate because project 80ff2ace5f7743679570b095ca58917d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:39:59.978224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:59.978954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-acbaa1b5-bf7c-4e27-a2c5-7f27d0cdc29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:39:59.980700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1225/2453] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:39:59 2022] DELETE /identity/v3/projects/80ff2ace5f7743679570b095ca58917d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:39:59.987130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:39:59.988007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:39:59.988470 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.011911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:00.013146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:00.110273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1229/2454] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:40:00.117818 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.118105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.118380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.140808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:00.142038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:00.154353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1226/2455] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:00.158962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.183630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc582c4f-6724-4d2d-aae0-76ce0ba9199d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.189712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.190780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.191164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.191531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.192384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:40:00.192725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.194447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.216145 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1230/2456] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:40:00.217021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.226678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9b2d-030e-45c6-9e19-77dea426617b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.232329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.236064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.236696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.237277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.238066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.240180 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.245983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:00.284377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1227/2457] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:40:00 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:40:00.288668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.299475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c1a82-8f05-4c79-be63-f38af229b566 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.380506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.381108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.381385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.381651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.382278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.384325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.411407 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1231/2458] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:40:00 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:40:00.413021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.442854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9e12-0789-4917-81f1-4fa1ae8a486d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.451335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.452250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.452706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.453139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.455185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.460409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.485804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.491806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:00.495127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1228/2459] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:00.498824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd4f3-7ed6-4d46-98f5-c19cb77b7d20 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.505679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.506430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.507195 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.507621 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.508370 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.510131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381aca-fab3-4108-87c2-9ddc8acadd48 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.522531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1232/2460] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:40:00.526844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.543229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bff9c-b194-45fd-a478-4291c8e31515 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.549734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.550638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.551350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.551877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] PATH_INFO: `/v3/projects/4c20360aec7a4d60b7260305ab7e1b2f/users/75a21876665f41c181a033dce1b0cea2/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.585875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20360aec7a4d60b7260305ab7e1b2f, user_id=75a21876665f41c181a033dce1b0cea2, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.589049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.620793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1229/2461] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:40:00 2022] PUT /identity/v3/projects/4c20360aec7a4d60b7260305ab7e1b2f/users/75a21876665f41c181a033dce1b0cea2/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:40:00.626733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340aaa-8de3-4af1-a6e5-375da3e9bac7 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.627012 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340aaa-8de3-4af1-a6e5-375da3e9bac7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.627279 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e340aaa-8de3-4af1-a6e5-375da3e9bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.656168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2e340aaa-8de3-4af1-a6e5-375da3e9bac7 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:00.657510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2e340aaa-8de3-4af1-a6e5-375da3e9bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:00.755062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1233/2462] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:00.767075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:00.779776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:00.841486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234a9-bd38-4052-b59e-29d74f29d130 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:00.847696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:00.848330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:00.848601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:00.848961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:00.859824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:00.861657 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:00.883255 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1230/2463] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:01.762423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad33c8-d8fd-4f1a-b413-d12645badaa1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:01.762941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad33c8-d8fd-4f1a-b413-d12645badaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:01.763034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad33c8-d8fd-4f1a-b413-d12645badaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:01.800106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-2cad33c8-d8fd-4f1a-b413-d12645badaa1 None None] MFA Rules not processed for user `75a21876665f41c181a033dce1b0cea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:01.802592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2cad33c8-d8fd-4f1a-b413-d12645badaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:01.897158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1234/2464] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:01.905665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:01.910320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:01.992842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda9be3-1d62-4cd6-bfa5-f74aba0ce039 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:01.999611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:02.000900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:02.001648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:02.002325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:02.024165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:02.026033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:02.047957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1231/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:03.610469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3924e-f3cf-4450-b3f0-a2ddd2b1da77 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:03.611081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3924e-f3cf-4450-b3f0-a2ddd2b1da77 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:03.611081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3924e-f3cf-4450-b3f0-a2ddd2b1da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:03.636520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4ca3924e-f3cf-4450-b3f0-a2ddd2b1da77 None None] MFA Rules not processed for user `75a21876665f41c181a033dce1b0cea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:03.638881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4ca3924e-f3cf-4450-b3f0-a2ddd2b1da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:03.662040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1235/2466] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:05.143561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:05.146270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:05.184359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55faf6-832c-4d0b-823f-8ae6dc3ea002 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:05.191387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:05.192290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:05.192571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:05.192847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] PATH_INFO: `/v3/users/42b12c1c10a64c85918a8c2255bc7e3a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:05.194089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b12c1c10a64c85918a8c2255bc7e3a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:05.195978 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:05.262909 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b12c1c10a64c85918a8c2255bc7e3a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.268185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:05.297906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b12c1c10a64c85918a8c2255bc7e3a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.298823 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b12c1c10a64c85918a8c2255bc7e3a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.308957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b12c1c10a64c85918a8c2255bc7e3a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.312210 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b12c1c10a64c85918a8c2255bc7e3a'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.337150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1232/2467] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:40:05 2022] DELETE /identity/v3/users/42b12c1c10a64c85918a8c2255bc7e3a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:05.341756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:05.342242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:05.342364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:05.365718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:05.367082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:05.452006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1236/2468] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:05.470505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:05.472090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:05.543707 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f31c9-311a-4ca7-864a-aea89f88dc78 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:05.548065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:05.548669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:05.548955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:05.549230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:05.558470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:05.560006 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:05.570084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1233/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:05.851740 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:05.853178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:05.865738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6c48-f098-4f90-bf02-d3424c32f77f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:05.870537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:05.871173 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:05.871444 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:05.871929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] PATH_INFO: `/v3/projects/dc0fcf8300e54a939b82672d55a8f261` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:05.873238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0fcf8300e54a939b82672d55a8f261)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:05.875492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:05.890700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:05.928679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0fcf8300e54a939b82672d55a8f261', 'request_id': 'req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.934364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0fcf8300e54a939b82672d55a8f261', 'request_id': 'req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.943010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0fcf8300e54a939b82672d55a8f261', 'request_id': 'req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.957018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] The token cache is being invalidate because project dc0fcf8300e54a939b82672d55a8f261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:40:05.957390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.957984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:05.959505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1237/2470] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:40:05 2022] DELETE /identity/v3/projects/dc0fcf8300e54a939b82672d55a8f261 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:05.963765 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:05.974312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607629ee-462c-4d08-8d5a-a2f9b319f0ec service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:06.035393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:06.036065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.036339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.036630 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] PATH_INFO: `/v3/users/3f440e3b1dc8471b8c4729c70a99f011` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.037789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f440e3b1dc8471b8c4729c70a99f011)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:06.039777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:06.089012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f440e3b1dc8471b8c4729c70a99f011'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.100600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f440e3b1dc8471b8c4729c70a99f011'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.101254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f440e3b1dc8471b8c4729c70a99f011'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.108836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f440e3b1dc8471b8c4729c70a99f011'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.109547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-19f1243e-f9ba-4263-abfa-0bffbf9dd29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f440e3b1dc8471b8c4729c70a99f011'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.110879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:06.125487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1234/2471] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:40:05 2022] DELETE /identity/v3/users/3f440e3b1dc8471b8c4729c70a99f011 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:06.506000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:06.507486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:06.533000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafff7e-21b1-4e30-8625-c2e5bbfb9234 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:06.617079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:06.617751 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.618033 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.618304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] PATH_INFO: `/v3/projects/ae4a31c5238149c78e12824e3c95116a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.619421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4a31c5238149c78e12824e3c95116a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:06.621366 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:06.669222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4a31c5238149c78e12824e3c95116a', 'request_id': 'req-56cd168b-021d-4b89-b15d-9e3a1f355596'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.675668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4a31c5238149c78e12824e3c95116a', 'request_id': 'req-56cd168b-021d-4b89-b15d-9e3a1f355596'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.683509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4a31c5238149c78e12824e3c95116a', 'request_id': 'req-56cd168b-021d-4b89-b15d-9e3a1f355596'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.695356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] The token cache is being invalidate because project ae4a31c5238149c78e12824e3c95116a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:40:06.695685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.696321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-56cd168b-021d-4b89-b15d-9e3a1f355596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:06.697785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1238/2472] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:40:06 2022] DELETE /identity/v3/projects/ae4a31c5238149c78e12824e3c95116a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:40:06.702860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.703329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.703444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.724870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:06.726070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:06.785339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1235/2473] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:06.794548 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.794742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.794964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.815078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:06.816323 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:06.827514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1239/2474] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:40:06.828754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:06.839499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cb6b2-ba58-4c5f-a128-ff147df86f62 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:06.846038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:06.846656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.846945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.847321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.847967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:40:06.848323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:06.850075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:06.867586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1236/2475] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:40:06.869975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:06.879883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10f1d7-65b8-4ca5-bc24-919cccf7d4a9 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:06.886670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:06.887378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.887694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.887976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.888819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:06.891185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:06.914609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:06.925803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1240/2476] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:40:06 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:40:06.926921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:06.936867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e6cf5-6dfd-481e-83aa-241f5520840c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:06.992491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:06.993087 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:06.993364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:06.993636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:06.994243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:06.996189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.016687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1237/2477] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:40:06 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:40:07.020827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.031569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f879ce-975a-44f7-bb31-78e83dd5abb5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.036113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.036707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.036984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.037251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.037883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.039462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.049882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1241/2478] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:07.053669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.063737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2760f-e9d4-4e66-8052-a97e1e5b6d2b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.068359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.068948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.069226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.069498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.070134 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.071755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe6338-caab-4760-aaa6-91df5e6384d6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.083124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1238/2479] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:07.087230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.097604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8afb4-c3d4-4f88-bada-c3254b0bdd96 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.102133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.102768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.103041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.103315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] PATH_INFO: `/v3/projects/7eb737c995b84772bbf5a7a5aed653df/users/4bbb42c0202446ee95ddedaa370d8237/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.117435 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb737c995b84772bbf5a7a5aed653df, user_id=4bbb42c0202446ee95ddedaa370d8237, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.120062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.131901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1242/2480] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:40:07 2022] PUT /identity/v3/projects/7eb737c995b84772bbf5a7a5aed653df/users/4bbb42c0202446ee95ddedaa370d8237/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:07.142493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.142849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.143191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.170736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] MFA Rules not processed for user `4bbb42c0202446ee95ddedaa370d8237`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:07.172008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:07.216614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:07.241530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1239/2481] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:07.252528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.254382 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:07.311840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b2f7-5c60-4908-a091-5ee2cf5426cc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.315882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.316501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.316781 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.317056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.327814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.330010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dabfc-eddf-4078-9753-d364703f37cd service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.345011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1243/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:40:07.367697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.459667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e428d-6a96-4278-9c0d-a930c7f59aa2 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.466749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.468827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.469318 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.469791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] PATH_INFO: `/v3/users/4bbb42c0202446ee95ddedaa370d8237` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.471246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbb42c0202446ee95ddedaa370d8237)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.473494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.532430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbb42c0202446ee95ddedaa370d8237'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:07.548529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbb42c0202446ee95ddedaa370d8237'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:07.549381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbb42c0202446ee95ddedaa370d8237'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:07.557476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbb42c0202446ee95ddedaa370d8237'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:07.558182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbb42c0202446ee95ddedaa370d8237'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:07.572830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1240/2483] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:40:07 2022] DELETE /identity/v3/users/4bbb42c0202446ee95ddedaa370d8237 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:07.577504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.578060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.578250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.601250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:07.602927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:07.757668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1244/2484] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:07.775843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:07.777601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:07.910504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8094c-fbb6-47b4-8b64-dcc013e04860 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:07.919964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:07.920581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:07.920859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:07.921127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:07.950609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:07.953043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2e4d3-5a54-4a4c-8e1a-d4524f64d3ba service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:07.966432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1241/2485] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:09.093595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.095450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:09.142672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b194b1e-d5ee-4a2f-b030-a174dfe03b31 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.164678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.167296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.168413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.168962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] PATH_INFO: `/v3/projects/7eb737c995b84772bbf5a7a5aed653df` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.172938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb737c995b84772bbf5a7a5aed653df)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.176881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.284499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb737c995b84772bbf5a7a5aed653df', 'request_id': 'req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:09.302423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb737c995b84772bbf5a7a5aed653df', 'request_id': 'req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:09.307976 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:09.318264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb737c995b84772bbf5a7a5aed653df', 'request_id': 'req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:09.337677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] The token cache is being invalidate because project 7eb737c995b84772bbf5a7a5aed653df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:40:09.338276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:09.339236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-aaad9df4-1139-4cab-a60b-77f4d5a8b92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:09.343160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1245/2486] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:40:09 2022] DELETE /identity/v3/projects/7eb737c995b84772bbf5a7a5aed653df => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:09.350861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.351894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.352356 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.372445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:09.382665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:09.385193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:09.483511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407046-1759-4978-96cc-71016a84a33b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.484113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407046-1759-4978-96cc-71016a84a33b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.484520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f407046-1759-4978-96cc-71016a84a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.485907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1242/2487] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:40:09.523630 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8f407046-1759-4978-96cc-71016a84a33b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:09.525155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8f407046-1759-4978-96cc-71016a84a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:09.536822 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1246/2488] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:09.543313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.561440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c544ca-f72a-423d-a8d0-1bf835f3d189 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.568088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.569119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.569658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.570123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.571870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:40:09.572457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.574939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.594550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407046-1759-4978-96cc-71016a84a33b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.599773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1243/2489] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:40:09.605059 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f407046-1759-4978-96cc-71016a84a33b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.610217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.611221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.611714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.612138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.612901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.616035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.649056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1247/2490] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:40:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:40:09.653275 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.664852 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca177058-56b6-4137-9acc-4e0e624869e9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.751495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.752234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.752517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.752908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.753800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.756165 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.780438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1244/2491] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:40:09 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:40:09.784827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.798226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4637dc0-3356-40ce-bb38-89e1df70d882 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.803356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.803902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.804186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.804456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.805390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.806921 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.820360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1248/2492] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:09.824305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.836297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8be775-0469-40b5-b3cc-b6b9f497434a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.842377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.843029 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.843887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.843887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.844532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.846516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38965c-57d8-494b-8924-481d9d1c72a0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.864974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1245/2493] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:09.865474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:09.891024 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30c8d8-070d-49c1-8f16-86e98c5422bf admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:09.905573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:09.908642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:09.909031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:09.919990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] PATH_INFO: `/v3/projects/d5ad241bfc8343bb9e2e620cd5054f27/users/924c028f20c24893ae4d11c15122770b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:09.970815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ad241bfc8343bb9e2e620cd5054f27, user_id=924c028f20c24893ae4d11c15122770b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:09.974252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:09.989879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1249/2494] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:40:09 2022] PUT /identity/v3/projects/d5ad241bfc8343bb9e2e620cd5054f27/users/924c028f20c24893ae4d11c15122770b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:10.001960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11419c-d622-498c-a6dc-ced630ce143c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:10.002239 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11419c-d622-498c-a6dc-ced630ce143c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:10.002650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11419c-d622-498c-a6dc-ced630ce143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:10.038663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-fb11419c-d622-498c-a6dc-ced630ce143c None None] MFA Rules not processed for user `924c028f20c24893ae4d11c15122770b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:10.040545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fb11419c-d622-498c-a6dc-ced630ce143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:10.131115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1246/2495] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:10.142433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:10.146207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:10.217929 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fede2c-60b1-45a6-a272-87b9dff0f46c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:10.221905 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:10.222859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:10.223293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:10.223588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:10.232474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:10.234432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:10.243676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1250/2496] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:12.304100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e36f2-74ef-4fb9-85a6-84c1606aadc0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:12.305081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e36f2-74ef-4fb9-85a6-84c1606aadc0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:12.305335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e36f2-74ef-4fb9-85a6-84c1606aadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:12.320469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:12.334293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-094e36f2-74ef-4fb9-85a6-84c1606aadc0 None None] MFA Rules not processed for user `f051f99404fc4e0593553ae95e1f90d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:12.336995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-094e36f2-74ef-4fb9-85a6-84c1606aadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:12.454334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1247/2497] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:13.534434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:13.596213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07ae16-66d9-419f-a5cf-1b1b8a4792ea service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:13.600864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:13.601491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:13.601766 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:13.602032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] PATH_INFO: `/v3/users/924c028f20c24893ae4d11c15122770b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:13.603163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=924c028f20c24893ae4d11c15122770b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:13.605110 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:13.644125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:13.659950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924c028f20c24893ae4d11c15122770b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:13.674188 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924c028f20c24893ae4d11c15122770b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:13.684575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924c028f20c24893ae4d11c15122770b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:13.686557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924c028f20c24893ae4d11c15122770b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:13.694821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924c028f20c24893ae4d11c15122770b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:13.703899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1251/2498] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:40:13 2022] DELETE /identity/v3/users/924c028f20c24893ae4d11c15122770b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:13.706483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:13.707856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:13.708211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:13.730367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:13.731618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:13.810664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1248/2499] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:13.820343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:13.821778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:13.899639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e2159-f5b4-4c13-8ee8-707b8a942b2f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:13.903814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:13.904462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:13.905300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:13.905573 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:13.914888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:13.916619 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a0cf6-44b4-4901-8737-bd1cf9fe8c58 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:13.926153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1252/2500] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:14.192097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.194010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:14.221313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f5a0-95d1-455a-96ce-266a90856e70 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.229467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.230181 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.230463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.231216 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] PATH_INFO: `/v3/projects/d5ad241bfc8343bb9e2e620cd5054f27` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.232750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ad241bfc8343bb9e2e620cd5054f27)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.244503 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.313692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ad241bfc8343bb9e2e620cd5054f27', 'request_id': 'req-9cd898b6-7b27-4399-9158-94e42f4f4108'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:14.320067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ad241bfc8343bb9e2e620cd5054f27', 'request_id': 'req-9cd898b6-7b27-4399-9158-94e42f4f4108'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:14.333494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ad241bfc8343bb9e2e620cd5054f27', 'request_id': 'req-9cd898b6-7b27-4399-9158-94e42f4f4108'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:14.348639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] The token cache is being invalidate because project d5ad241bfc8343bb9e2e620cd5054f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:40:14.348946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:14.349993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9cd898b6-7b27-4399-9158-94e42f4f4108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:14.352092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1249/2501] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:40:14 2022] DELETE /identity/v3/projects/d5ad241bfc8343bb9e2e620cd5054f27 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:14.357265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.357590 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.357874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.399185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:14.400515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:14.492556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1253/2502] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:40:14.501325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.501672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.501992 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.524613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:14.525869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:14.538523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1250/2503] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:14.539255 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.552806 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057dfc0-f3a9-4a30-8a97-aaacd2883464 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.566038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.567022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.567399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.567761 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.568445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:40:14.568743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.570726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.598317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1254/2504] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:40:14.603205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.616972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3c36-2376-47ba-86cd-67ba27ca35c5 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.625773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.626514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.626789 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.627106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.627856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.629888 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.662671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1251/2505] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:40:14 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:40:14.667699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.680881 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fe8a-26a6-45e3-82fd-a1431726c032 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.736430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:14.764443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.765281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.765879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.765879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.766436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.768403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.797534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1255/2506] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:40:14 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:40:14.801475 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.806989 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:14.813480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b75fe-3d50-4a03-8d8c-ed29718173e8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.820365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.821285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.821791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.822254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.822907 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.824880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.837781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1252/2507] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:40:14.842148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.853138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf6936-8d11-4bd8-92d6-ee5dd8138d3b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.858468 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.859104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.859378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.859676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.860317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.861951 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8ec8-89f9-4050-a549-120f7869fb7c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.872164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1256/2508] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:40:14.876958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:14.886833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24b4f-d1c6-46c3-b75b-b1c0e4082bdf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:14.891424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:14.892104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.892379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.892649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] PATH_INFO: `/v3/projects/a01debb1f01a404c8b5a7fcdf043639f/users/3d997ea5184347dab10b9ec59e7fa622/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.909685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01debb1f01a404c8b5a7fcdf043639f, user_id=3d997ea5184347dab10b9ec59e7fa622, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:14.912360 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:14.928604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1253/2509] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:40:14 2022] PUT /identity/v3/projects/a01debb1f01a404c8b5a7fcdf043639f/users/3d997ea5184347dab10b9ec59e7fa622/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:14.941264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:14.941550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:14.941892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:14.971773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] MFA Rules not processed for user `3d997ea5184347dab10b9ec59e7fa622`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:14.973142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:15.050899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1257/2510] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:15.058499 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:15.060284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:15.121105 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19838b-79c2-4339-9d53-024045f5a692 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:15.124976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:15.125617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:15.125915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:15.126172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:15.135043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:15.136585 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:15.155892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1254/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:24.906155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:24.907625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:24.970355 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb6ea9-3fbb-4350-a248-c2b38704358a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:24.974096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:24.974702 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:24.974983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:24.975257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:24.977100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:25.043800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:25.045217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:25.049179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:25.056836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1258/2512] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:25.149548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:30.454102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:30.469359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3f26-0c4c-448f-8f00-f6e944e5c66b service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:30.484649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:30.484649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:30.484649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:30.484649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:30.484987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:30.560320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:30.561902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637c4a-178f-4a42-9746-4c8e06a78920 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:30.572927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1255/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:35.058275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:40.568629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=30 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:59.173648 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:59.236890 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913e06-d93f-4ace-94cc-124472d6a995 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:59.241387 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:59.242006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:59.242281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:59.242549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] PATH_INFO: `/v3/users/3d997ea5184347dab10b9ec59e7fa622` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:59.243814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d997ea5184347dab10b9ec59e7fa622)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:59.245725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:59.290454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d997ea5184347dab10b9ec59e7fa622'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:59.302770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d997ea5184347dab10b9ec59e7fa622'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:59.311825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d997ea5184347dab10b9ec59e7fa622'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:59.312512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d997ea5184347dab10b9ec59e7fa622'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:59.319361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d997ea5184347dab10b9ec59e7fa622'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:40:59.325133 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1259/2514] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:40:59 2022] DELETE /identity/v3/users/3d997ea5184347dab10b9ec59e7fa622 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:40:59.329616 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:59.330072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:59.330171 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:59.349337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:40:59.350537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:59.407843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1256/2515] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:40:59.417443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:59.418825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:59.475937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15de2-a388-4df3-9bbd-63c272bafba2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:59.479663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:59.480259 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:59.480536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:59.480801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:59.490291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:59.491799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:40:59.501084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1260/2516] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:40:59.937732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:40:59.939170 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:40:59.950902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8bd21-4f66-4cf3-a4fb-67074069cf88 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:40:59.956332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:40:59.956958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:40:59.957229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:40:59.957494 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] PATH_INFO: `/v3/projects/a01debb1f01a404c8b5a7fcdf043639f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:40:59.958605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01debb1f01a404c8b5a7fcdf043639f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:40:59.960537 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:41:00.007204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01debb1f01a404c8b5a7fcdf043639f', 'request_id': 'req-e7ebbb72-705a-4c83-a89b-6f127d26ff37'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:41:00.012950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01debb1f01a404c8b5a7fcdf043639f', 'request_id': 'req-e7ebbb72-705a-4c83-a89b-6f127d26ff37'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:41:00.020708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01debb1f01a404c8b5a7fcdf043639f', 'request_id': 'req-e7ebbb72-705a-4c83-a89b-6f127d26ff37'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:41:00.031464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] The token cache is being invalidate because project a01debb1f01a404c8b5a7fcdf043639f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:41:00.031776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:41:00.032394 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7ebbb72-705a-4c83-a89b-6f127d26ff37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:41:00.033842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1257/2517] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:40:59 2022] DELETE /identity/v3/projects/a01debb1f01a404c8b5a7fcdf043639f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:41:09.496957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:10.028525 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:22.809549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:41:22.810966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:41:22.878678 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd91784-4dd7-4bec-954a-e0815a63fab8 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:41:22.935916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:41:22.936509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:41:22.936787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:41:22.937056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:41:22.938757 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:41:22.949609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:41:22.951708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a57c-79b5-4884-8c22-6c0fa169764c service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:41:22.961649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1261/2518] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:41:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:41:32.322067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53025-271e-4859-aada-7c01c72be55e None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:41:32.322608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53025-271e-4859-aada-7c01c72be55e None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:41:32.322608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53025-271e-4859-aada-7c01c72be55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:41:32.343443 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-36e53025-271e-4859-aada-7c01c72be55e None None] MFA Rules not processed for user `75a21876665f41c181a033dce1b0cea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:41:32.344659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-36e53025-271e-4859-aada-7c01c72be55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:41:32.398955 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1258/2519] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:41:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:41:32.957530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=58 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:42.392905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=25 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:03.490990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:03.491499 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:03.491642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:03.513485 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] MFA Rules not processed for user `f051f99404fc4e0593553ae95e1f90d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:42:03.514694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:03.580563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1262/2520] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:42:13.571310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=25 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:23.052068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:23.052607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:23.052607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:23.071426 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] MFA Rules not processed for user `d0aea5553e1043889571c50c3b01cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:42:23.072642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:23.125913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1259/2521] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:42:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:42:33.119477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=25 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:33.661030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:33.663958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:33.736909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5180cc-ebf7-489d-9368-3698b6b84d5c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:33.741638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:33.742264 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:33.742539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:33.742808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] PATH_INFO: `/v3/users/75a21876665f41c181a033dce1b0cea2` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:33.743975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a21876665f41c181a033dce1b0cea2)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:33.745883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:33.799001 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a21876665f41c181a033dce1b0cea2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:33.812107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a21876665f41c181a033dce1b0cea2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:33.820105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a21876665f41c181a033dce1b0cea2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:33.820924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a21876665f41c181a033dce1b0cea2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:33.828970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a21876665f41c181a033dce1b0cea2'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:33.835916 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1263/2522] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:42:33 2022] DELETE /identity/v3/users/75a21876665f41c181a033dce1b0cea2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:42:34.014733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:34.026648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ff7e-e048-49f8-89bd-3a398b93d560 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:34.096051 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:34.096826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:34.097117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:34.097467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] PATH_INFO: `/v3/projects/4c20360aec7a4d60b7260305ab7e1b2f` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:34.098690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20360aec7a4d60b7260305ab7e1b2f)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:34.100994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:34.150408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20360aec7a4d60b7260305ab7e1b2f', 'request_id': 'req-708d0c43-be47-4d74-8037-652b386bc5a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:34.157070 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20360aec7a4d60b7260305ab7e1b2f', 'request_id': 'req-708d0c43-be47-4d74-8037-652b386bc5a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:34.166755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20360aec7a4d60b7260305ab7e1b2f', 'request_id': 'req-708d0c43-be47-4d74-8037-652b386bc5a8'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:34.183579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] The token cache is being invalidate because project 4c20360aec7a4d60b7260305ab7e1b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:42:34.183981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:34.184882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-708d0c43-be47-4d74-8037-652b386bc5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:34.186676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1260/2523] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:42:34 2022] DELETE /identity/v3/projects/4c20360aec7a4d60b7260305ab7e1b2f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:42:40.126571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:40.128026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:40.184083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882907e-c7a6-470a-aaa9-7c70dc4fd8b4 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:40.216837 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:40.234859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:40.235450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:40.235750 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:40.236016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:40.237697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:40.305465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:40.306877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:40.317451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1264/2524] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:42:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:42:42.649229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:42.649682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:42.649783 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:42.669158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:42:42.670344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:42.724561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1261/2525] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:42:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:42:42.768063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:42.769543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:42.836399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5f43-ac2f-48c7-83c5-a5dc010811e2 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:42.841802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:42.842384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:42.842717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:42.842985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:42.851080 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:42.852697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:42.860434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1265/2526] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:42:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:45.467905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:45.469848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:45.530782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:45.550111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d83baa-8d5c-4910-8fd0-0fa7a7cd9b94 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:45.553755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:45.554367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:45.554640 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:45.554937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:45.556758 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:45.571253 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:45.572706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:45.585115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1262/2527] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:42:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:42:49.557503 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:49.560533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:49.636365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68590-b3db-450c-bbbf-974c823cf384 service swift] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:49.640877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:49.641505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:49.641787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:49.642056 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] PATH_INFO: `/v3/users/954309a32da947518f8ad201dfa51ccb` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:49.643193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=954309a32da947518f8ad201dfa51ccb)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:49.645146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:49.650538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:49.696003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954309a32da947518f8ad201dfa51ccb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:49.709179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954309a32da947518f8ad201dfa51ccb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:49.718160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954309a32da947518f8ad201dfa51ccb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:49.718732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954309a32da947518f8ad201dfa51ccb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:49.726351 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954309a32da947518f8ad201dfa51ccb'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:49.733063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1266/2528] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:42:49 2022] DELETE /identity/v3/users/954309a32da947518f8ad201dfa51ccb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:42:49.907819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:49.924158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e150a-7ab8-437d-a9ec-9c43a8a7dc88 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:49.981063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:49.981617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:49.981894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:49.982167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] PATH_INFO: `/v3/projects/8c0e70db84d64777af111825ff71df8c` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:49.983270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0e70db84d64777af111825ff71df8c)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:49.985228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:50.030125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0e70db84d64777af111825ff71df8c', 'request_id': 'req-20387e92-8f6a-4d3c-b1cf-024eb3017a38'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.035922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0e70db84d64777af111825ff71df8c', 'request_id': 'req-20387e92-8f6a-4d3c-b1cf-024eb3017a38'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.044016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0e70db84d64777af111825ff71df8c', 'request_id': 'req-20387e92-8f6a-4d3c-b1cf-024eb3017a38'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.054923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] The token cache is being invalidate because project 8c0e70db84d64777af111825ff71df8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:42:50.055206 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.055847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.057310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1263/2529] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:42:49 2022] DELETE /identity/v3/projects/8c0e70db84d64777af111825ff71df8c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:42:50.061411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:50.062942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:50.076175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d9af6-cdeb-4ac6-a821-74a3cf679a2d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:50.132221 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:50.132838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:50.133113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:50.133383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] PATH_INFO: `/v3/users/891c88ffdb204d468a839e57671b0736` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:50.134486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891c88ffdb204d468a839e57671b0736)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:50.136948 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:50.182208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891c88ffdb204d468a839e57671b0736'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.195267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891c88ffdb204d468a839e57671b0736'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.203199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891c88ffdb204d468a839e57671b0736'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.203824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891c88ffdb204d468a839e57671b0736'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.212178 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891c88ffdb204d468a839e57671b0736'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.219013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1267/2530] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:42:50 2022] DELETE /identity/v3/users/891c88ffdb204d468a839e57671b0736 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:42:50.393432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:50.394963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:50.412805 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387e92-8f6a-4d3c-b1cf-024eb3017a38 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:50.475404 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:50.476075 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:50.476355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:50.476622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] PATH_INFO: `/v3/projects/604aeb060e9f4407900dd86f522c2bc1` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:50.477727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] RBAC: Authorizing `identity:delete_project(project_id=604aeb060e9f4407900dd86f522c2bc1)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:50.479654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:50.491388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:50.529329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604aeb060e9f4407900dd86f522c2bc1', 'request_id': 'req-742717fc-c1f2-4f0e-a1cb-c0f465a523af'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.534977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604aeb060e9f4407900dd86f522c2bc1', 'request_id': 'req-742717fc-c1f2-4f0e-a1cb-c0f465a523af'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.544143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604aeb060e9f4407900dd86f522c2bc1', 'request_id': 'req-742717fc-c1f2-4f0e-a1cb-c0f465a523af'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.555285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] The token cache is being invalidate because project 604aeb060e9f4407900dd86f522c2bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:42:50.555602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.556245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:42:50.558468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1264/2531] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:42:50 2022] DELETE /identity/v3/projects/604aeb060e9f4407900dd86f522c2bc1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:42:54.879805 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:42:54.881272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:54.888285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:54.939443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173874-0ed6-4379-8068-9b3a8f4488f6 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:42:54.987087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:42:54.987723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:42:54.988006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:42:54.988280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:42:54.989992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:42:55.046930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:42:55.048425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:42:55.057400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1268/2532] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:00.552254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:04.812030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:04.813453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:04.869799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742717fc-c1f2-4f0e-a1cb-c0f465a523af admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:04.873867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:04.874471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:04.874752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:04.875027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:04.876729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:04.937536 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:04.938953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:04.949031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1265/2533] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:05.053297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=66 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:08.090253 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.092424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.155067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.157057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.170531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff356fc-f945-4433-813c-ac943ef2fdcf service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.174983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.175654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.175935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.176207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] PATH_INFO: `/v3/users/f051f99404fc4e0593553ae95e1f90d5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.177332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f051f99404fc4e0593553ae95e1f90d5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.179235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.186319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee295af-4070-4ede-b78a-2b0be575fe71 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.191848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.192452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.193010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.193384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.195442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.211975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.213817 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.224091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1269/2534] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:08.231453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f051f99404fc4e0593553ae95e1f90d5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.246938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f051f99404fc4e0593553ae95e1f90d5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.247656 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f051f99404fc4e0593553ae95e1f90d5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.256681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f051f99404fc4e0593553ae95e1f90d5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.257301 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-e7f73662-5deb-4b4e-a705-ade64e2fe168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f051f99404fc4e0593553ae95e1f90d5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.269725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1266/2535] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:43:08 2022] DELETE /identity/v3/users/f051f99404fc4e0593553ae95e1f90d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:43:08.440011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.450792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1607e-fc8e-4966-abea-3b4f04f8ae2b service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.523260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.524052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.524329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.524598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] PATH_INFO: `/v3/projects/2f3596b4a1404d3db340943fbd63567d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.525726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3596b4a1404d3db340943fbd63567d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.528210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.578862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3596b4a1404d3db340943fbd63567d', 'request_id': 'req-40c301c6-26ec-4a10-9ae4-f048ac75e216'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.584922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3596b4a1404d3db340943fbd63567d', 'request_id': 'req-40c301c6-26ec-4a10-9ae4-f048ac75e216'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.594917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3596b4a1404d3db340943fbd63567d', 'request_id': 'req-40c301c6-26ec-4a10-9ae4-f048ac75e216'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.610215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] The token cache is being invalidate because project 2f3596b4a1404d3db340943fbd63567d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:43:08.610215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.610769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:08.612313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1270/2536] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:43:08 2022] DELETE /identity/v3/projects/2f3596b4a1404d3db340943fbd63567d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:43:08.617382 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155459-c283-49d6-8994-2a9da3b25360 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.617665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155459-c283-49d6-8994-2a9da3b25360 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.617983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155459-c283-49d6-8994-2a9da3b25360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.637118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-c0155459-c283-49d6-8994-2a9da3b25360 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:08.638300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c0155459-c283-49d6-8994-2a9da3b25360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.655378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:08.682137 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.683798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.700144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1267/2537] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:08.708058 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:08.708246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.708425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.708688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.730660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:08.731895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.740244 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1268/2538] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:43:08.744341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.746759 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c301c6-26ec-4a10-9ae4-f048ac75e216 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.750598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.751789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.752070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.752341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.753305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73e85-df55-4b5c-9441-a9da47d75416 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.754160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:08.757908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.758493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.758773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.759047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.759731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:43:08.760040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.761665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.763880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.765303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.773228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1271/2539] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:43:08.776010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1269/2540] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:43:08.780891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.792474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5006e-8f56-4bea-9bb3-d3434945f0dd service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.797197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.797823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.798099 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.798368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.798999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.801171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.831347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1272/2541] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:43:08 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:43:08.832501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.843860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b39a-d3e4-44e2-b889-d4a115126f0b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.902773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.903492 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.903863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.904201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.904885 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.907320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.931097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1270/2542] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:43:08 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:43:08.932601 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.943070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5fb3-dd43-4d0f-8cb5-407d8638cbf1 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.947798 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.948903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.949179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.949451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.950218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.951843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.963346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1273/2543] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:43:08.968008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:08.977994 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78b72-92e7-4711-88f6-a9ce3f5dc70f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:08.982667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:08.983267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:08.983564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:08.983857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:08.984517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:08.986148 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160878ff-cd7a-4713-9daa-4964ad5b9d23 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:08.997947 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1271/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:43:09.002249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:09.013304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97478a4-2271-420a-b98e-8d4a26cc795a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:09.018348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:09.018995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:09.019273 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:09.019566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] PATH_INFO: `/v3/projects/eb857c94e3f6405baad84dfc45445b0d/users/d586af36267c475ab5af42a23ce3f1b1/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:09.035688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb857c94e3f6405baad84dfc45445b0d, user_id=d586af36267c475ab5af42a23ce3f1b1, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:09.038363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:09.051183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1274/2545] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:43:09 2022] PUT /identity/v3/projects/eb857c94e3f6405baad84dfc45445b0d/users/d586af36267c475ab5af42a23ce3f1b1/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:43:09.058576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:09.058576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:09.058576 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:09.076188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:09.077410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:09.137915 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1272/2546] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:43:09.149025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:09.150790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:09.213364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad5048-60ba-4ce8-8581-7523eed5d35b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:09.217987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:09.218767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:09.219219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:09.219722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:09.230952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:09.232741 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:09.243583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1275/2547] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:10.622261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:10.624094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:10.654007 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:10.745942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2518a9-f7fe-47d0-8761-2d5a2e55e0a6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:10.752403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:10.753514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:10.757136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:10.757136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:10.759256 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:10.836065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:10.837705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474acc4d-b87f-433e-82c5-dbd921477b48 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:10.852120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1273/2548] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:13.178174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:13.189939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd158028-313c-4406-a436-d4336d5d1a75 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:13.196476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:13.197223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.197564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.197922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.200319 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.217343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:13.219018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabef3f-b23e-4fa3-8dc7-27c76a64a08d service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:13.232640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1276/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:13.293350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.293869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.294293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.334415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] MFA Rules not processed for user `d586af36267c475ab5af42a23ce3f1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:13.335898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.412707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e926b-0ee5-4c38-b908-8c3706301dc7 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.412995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e926b-0ee5-4c38-b908-8c3706301dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.413272 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e926b-0ee5-4c38-b908-8c3706301dc7 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.415020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1277/2550] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 08:43:13.427054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.427164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.427446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.471843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1274/2551] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:43:13.473413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:13.475662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.483727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1278/2552] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:13.486636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:13.502525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:13.503040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f0de2-30fc-42ea-b92e-7efb3170ff0c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:13.510131 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:13.511713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.512118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.512547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.519529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cccd-0589-4e8e-b3f6-2a3fbd341f8a None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:13.527055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:13.527693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.528144 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.528250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.529085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:13.531716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327d1e0-5ecf-4765-a638-e5f7f3c5ff45 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:13.536292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:13.537788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61bc2-59e0-48a1-b61a-9ec09122b7be service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:13.545759 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1275/2553] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:13.547111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1279/2554] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:43:13.650552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b41de6-130d-479f-b071-615a5f02bf1f None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.650871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b41de6-130d-479f-b071-615a5f02bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.652654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b41de6-130d-479f-b071-615a5f02bf1f None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.654644 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1276/2555] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:43:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:43:13.660504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.660859 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.661218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.681524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:13.683104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.693091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1280/2556] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:13.705731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b41de6-130d-479f-b071-615a5f02bf1f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:13.719077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b41de6-130d-479f-b071-615a5f02bf1f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:13.722845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:13.723478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.723780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.724056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.736958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:13.738469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cb964-7b4b-4892-8ba1-179a949eb48b service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:13.751754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1277/2557] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:13.862305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:13.864151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.911415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:13.959978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e95d8b-2a64-441c-a299-92b06238fb32 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:13.966126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:13.966865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:13.967214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:13.967587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:13.969460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:13.982249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:13.984032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:13.997420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1281/2558] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:15.543182 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:15.543686 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:15.543799 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:15.563264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] MFA Rules not processed for user `d586af36267c475ab5af42a23ce3f1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:15.564567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:15.571665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1278/2559] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:18.861674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:18.873992 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484cef-e3b3-4f9d-8a2d-eac4d2d5bb75 service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:18.879398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:18.880021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:18.880298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:18.880563 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:18.882280 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:18.895036 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:18.896639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:18.907868 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1282/2560] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:25.558407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:28.903230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=25 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:31.480434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:31.481716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:31.497956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f08b3-4518-4097-81f2-8dca328eb8a8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:31.503440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:31.504078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:31.504362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:31.504633 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:31.506325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:31.519048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:31.520609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:31.532208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1279/2561] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:41.528532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:41.796146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:41.805393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1873ac-e699-4d9a-9a10-83e0d7e03550 service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:41.808965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:41.809552 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:41.809826 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:41.810093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:41.811844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:41.823325 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:41.825275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:41.835021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1283/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:44.924179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:44.925650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:44.941669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a2f-4a29-41eb-86a4-27b9553479cb service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:44.946420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:44.947147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:44.947659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:44.947942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] PATH_INFO: `/v3/users/d0aea5553e1043889571c50c3b01cacc` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:44.949140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0aea5553e1043889571c50c3b01cacc)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:44.951183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:44.998440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0aea5553e1043889571c50c3b01cacc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.010457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0aea5553e1043889571c50c3b01cacc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.011120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0aea5553e1043889571c50c3b01cacc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.018344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0aea5553e1043889571c50c3b01cacc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.018987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-10f180a6-5e5c-461f-9d71-1fd5096da0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0aea5553e1043889571c50c3b01cacc'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.030930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1280/2563] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:43:44 2022] DELETE /identity/v3/users/d0aea5553e1043889571c50c3b01cacc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:43:45.205352 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.216809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7c113-6fed-433a-bc18-bb1be9ae3785 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.279349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.280002 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.280283 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.280554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] PATH_INFO: `/v3/projects/458a894213fa47d78568eefbb75f05b3` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.281713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458a894213fa47d78568eefbb75f05b3)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.283709 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.329996 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458a894213fa47d78568eefbb75f05b3', 'request_id': 'req-63732cf3-7216-4c9b-86ac-24e10783d745'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.335418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458a894213fa47d78568eefbb75f05b3', 'request_id': 'req-63732cf3-7216-4c9b-86ac-24e10783d745'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.342623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458a894213fa47d78568eefbb75f05b3', 'request_id': 'req-63732cf3-7216-4c9b-86ac-24e10783d745'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.353459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] The token cache is being invalidate because project 458a894213fa47d78568eefbb75f05b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:43:45.353747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.354397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-63732cf3-7216-4c9b-86ac-24e10783d745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:43:45.356562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1284/2564] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:43:45 2022] DELETE /identity/v3/projects/458a894213fa47d78568eefbb75f05b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:43:45.361659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.361944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.362219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.381660 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:45.382868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:45.443212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1281/2565] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:45.451174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.451478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.451782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.472232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:45.473464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:45.481924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1285/2566] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:45.486103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.495923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ada82a-1c28-4a0c-8e97-62fab0f336d4 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.500502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.501098 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.501375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.501646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.502282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:43:45.502583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.504204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.516028 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1282/2567] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:43:45.519999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.529676 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571a41a-3c44-4e75-9d64-34c2563ea061 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.534229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.534814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.535092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.535362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.536055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.537935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.564084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1286/2568] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:43:45 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:43:45.568052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.578311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf349dd-2e33-4243-8f39-767b7de87413 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.634679 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.635221 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.635504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.635807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.636437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.638859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.646609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:45.663763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1283/2569] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:43:45 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:43:45.664986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.675072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec93503-0139-4d6d-a267-707d8490b382 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.679646 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.680234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.680508 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.680776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.681399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.682998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.692682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1287/2570] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:43:45.696546 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.707124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d5a46-7688-4fc9-b061-1428a5491f12 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.711953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.712547 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.712849 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.713123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.713782 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.716112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1f94-3855-42b6-a081-f2e004eb48e2 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.727368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1284/2571] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:43:45.731248 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.741117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfc989-0d98-4e2d-81e5-e8a464a912e5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.745735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.746402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.746675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.746939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] PATH_INFO: `/v3/projects/34b106e46b2c4fb292353a6176c9f699/users/49114d25c04144269e3eb88448e2c2ee/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.761167 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b106e46b2c4fb292353a6176c9f699, user_id=49114d25c04144269e3eb88448e2c2ee, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.764603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.776998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1288/2572] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:43:45 2022] PUT /identity/v3/projects/34b106e46b2c4fb292353a6176c9f699/users/49114d25c04144269e3eb88448e2c2ee/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:43:45.782563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea2d84-297e-447a-91d4-6f2734775000 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.782845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea2d84-297e-447a-91d4-6f2734775000 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.783139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea2d84-297e-447a-91d4-6f2734775000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.801383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d9ea2d84-297e-447a-91d4-6f2734775000 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:45.802572 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d9ea2d84-297e-447a-91d4-6f2734775000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:45.860234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1285/2573] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:45.869810 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:45.871987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:45.886026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:45.930904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf4b3-b65e-42a7-9105-3ac389bf9e2f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:45.935044 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:45.935670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:45.935944 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:45.936206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:45.945179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:45.946572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:45.956831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1289/2574] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:49.870496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425a63-dc87-4f67-9a68-07130ea7aa34 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:49.871019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425a63-dc87-4f67-9a68-07130ea7aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:49.871019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425a63-dc87-4f67-9a68-07130ea7aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:49.899677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-55425a63-dc87-4f67-9a68-07130ea7aa34 None None] MFA Rules not processed for user `49114d25c04144269e3eb88448e2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:49.900943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-55425a63-dc87-4f67-9a68-07130ea7aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:49.969230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1286/2575] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:49.985930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:49.987369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:50.065055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea8a7-deb3-4b09-a643-4e52de8a84cc service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:50.070566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:50.071181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:50.071493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:50.071797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:50.081071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:50.082688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:50.092977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1290/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:43:51.355781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:51.356334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:51.356334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:51.375693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] MFA Rules not processed for user `49114d25c04144269e3eb88448e2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:43:51.376927 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:51.383778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1287/2577] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:43:51.703701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:43:51.705321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:51.718726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b02e0-1300-446b-b269-793e6248ccff service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:43:51.722334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:43:51.722943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:43:51.723212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:43:51.723478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:43:51.725216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:43:51.735337 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:43:51.736792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d2419-6fd0-45bf-8f32-12cc6c2a0043 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:43:51.745034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1291/2578] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:43:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:01.369682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:01.741214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=60 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:02.509162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:02.522477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168bfd2-43be-475a-a715-e2c25041b710 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:02.528485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:02.529083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:02.529359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:02.529629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:02.531381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:02.544184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:02.545767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:02.556534 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1288/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:12.551830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:24.357015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225961-7ec5-4536-9448-420bfe351e49 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:24.357505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225961-7ec5-4536-9448-420bfe351e49 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:24.357613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73225961-7ec5-4536-9448-420bfe351e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:24.377111 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-73225961-7ec5-4536-9448-420bfe351e49 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:24.378644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-73225961-7ec5-4536-9448-420bfe351e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:24.433341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1292/2580] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:44:24.480733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:24.483333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:24.555647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851959-d0ae-410c-a9b6-777ecbe2fc2e service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:24.561355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:24.561959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:24.562236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:24.562505 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:24.570459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:24.572053 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde94a-4d19-402d-b226-bc051d588eb3 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:24.581967 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1289/2581] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:44:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:44:34.426474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=25 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:34.578115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=32 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:37.065623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.066200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.066200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.067736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1293/2582] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:44:37.073753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068513-836e-4d2a-a298-7b34f5f8844b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.074227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068513-836e-4d2a-a298-7b34f5f8844b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.074335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068513-836e-4d2a-a298-7b34f5f8844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.095514 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-60068513-836e-4d2a-a298-7b34f5f8844b None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:37.096654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-60068513-836e-4d2a-a298-7b34f5f8844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:37.106974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1290/2583] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:44:37.118403 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:37.120232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:37.181198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04045c79-b972-4bf1-a9f0-abbaca155642 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:37.184854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:37.185453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.185725 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.185989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.197010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:37.198429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934be2-c12d-4df9-9a64-d87b277acfe1 service glance] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:37.209858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1294/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:37.279204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2561-9ce9-4e4b-927c-a4250d907f94 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.279479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2561-9ce9-4e4b-927c-a4250d907f94 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.279796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2561-9ce9-4e4b-927c-a4250d907f94 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.281126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1291/2585] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:44:37.285763 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e018ca-ea6a-4b03-b676-7aa5fca80743 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.286049 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e018ca-ea6a-4b03-b676-7aa5fca80743 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.286322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e018ca-ea6a-4b03-b676-7aa5fca80743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.305878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-92e018ca-ea6a-4b03-b676-7aa5fca80743 None None] MFA Rules not processed for user `1e7a5e0bc9174566804a188cdcd08047`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:37.307084 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-92e018ca-ea6a-4b03-b676-7aa5fca80743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:37.313575 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1295/2586] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:44:37.325521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2561-9ce9-4e4b-927c-a4250d907f94 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:37.336825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2561-9ce9-4e4b-927c-a4250d907f94 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:37.340949 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:37.341558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.341836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.342109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.349159 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:37.350535 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a89f-da95-4d9d-a2c7-239ea07b01b4 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:37.358264 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1292/2587] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:44:37.438935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19510-f8a1-4ee3-b82b-ca2c54beea1f None None] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.439223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19510-f8a1-4ee3-b82b-ca2c54beea1f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.439524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19510-f8a1-4ee3-b82b-ca2c54beea1f None None] PATH_INFO: `/` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.440932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1296/2588] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:44:37.445950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0305-2284-4c6a-87c5-c3de2b387309 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.446234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0305-2284-4c6a-87c5-c3de2b387309 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.446508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0305-2284-4c6a-87c5-c3de2b387309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.467406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-87fd0305-2284-4c6a-87c5-c3de2b387309 None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:37.468639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-87fd0305-2284-4c6a-87c5-c3de2b387309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:37.477869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1293/2589] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:44:37.488825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19510-f8a1-4ee3-b82b-ca2c54beea1f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:37.500333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19510-f8a1-4ee3-b82b-ca2c54beea1f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:37.504009 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:37.504597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:37.504876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:37.505142 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:37.515013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:37.516456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:37.526899 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1297/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:40.026185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:40.026680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:40.026776 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:40.046341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:40.047529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:40.054730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1294/2591] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:44:40.067169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:40.079665 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42a43-81ab-46a1-a3c7-864ba41778c8 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:40.084860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:40.085461 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:40.085738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:40.086007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:40.094952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:40.096561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:40.104695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1298/2592] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:44:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:44:48.628204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:48.638334 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec966bb-1328-4dc9-beb4-3247ca97b465 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:48.641945 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:48.642539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:48.642816 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:48.643085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:48.644781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:48.702482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:48.704155 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1606e1-a7b7-49fd-b04f-2114da9a440a service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:48.713681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1295/2593] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:50.101369 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=41 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:53.752336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:44:53.761823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f620544-dd03-4b0b-8876-2e64b01fbca3 service swift] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:44:53.766193 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:44:53.766787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:53.767060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:53.767327 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:53.769096 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:53.781356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:44:53.782768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb2a52-5239-45ed-89ac-4b63940e2145 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:44:53.793249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1299/2594] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:44:57.181084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:44:57.181567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:44:57.181880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:44:57.205591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] MFA Rules not processed for user `49114d25c04144269e3eb88448e2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:44:57.209231 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:44:57.214137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1296/2595] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:44:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:00.007844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:00.008399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:00.008399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:00.039143 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:00.040839 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:00.058427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1300/2596] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:00.075001 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:00.098083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356d54-379b-40b3-a257-1aefd707fa02 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:00.107097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:00.107921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:00.108207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:00.108483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:00.119425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:00.121054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:00.130768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1297/2597] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:45:01.209635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:01.211093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:01.288868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:01.291226 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:01.306113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137bb4-dfff-447c-b874-c66e67f989d6 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:01.311454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:01.312478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:01.312964 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:01.313391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] PATH_INFO: `/v3/users/73ea9b3af8884377888513b608669afa` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:01.314722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ea9b3af8884377888513b608669afa)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:01.316882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:01.318880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde28d41-ff76-43b3-a542-96ae8f543a76 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:01.324438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:01.327611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:01.327900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:01.329504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:01.331624 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:01.347449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:01.349889 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:01.364857 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1301/2598] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:45:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:45:01.393936 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ea9b3af8884377888513b608669afa'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.413732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ea9b3af8884377888513b608669afa'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.414445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ea9b3af8884377888513b608669afa'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.422304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ea9b3af8884377888513b608669afa'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.423191 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ea9b3af8884377888513b608669afa'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.435670 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1298/2599] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:45:01 2022] DELETE /identity/v3/users/73ea9b3af8884377888513b608669afa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:01.724447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:01.737304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3588-428e-4bc7-bef1-5b205893c41a service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:01.800977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:01.801626 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:01.801880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:01.802146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] PATH_INFO: `/v3/projects/08ccc5a670c049eda6e6f5b97b73ebec` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:01.803251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ccc5a670c049eda6e6f5b97b73ebec)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:01.805233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:01.853180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ccc5a670c049eda6e6f5b97b73ebec', 'request_id': 'req-cc7f4414-faf6-4157-9e84-3458eb4b4f51'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.859405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ccc5a670c049eda6e6f5b97b73ebec', 'request_id': 'req-cc7f4414-faf6-4157-9e84-3458eb4b4f51'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.868021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ccc5a670c049eda6e6f5b97b73ebec', 'request_id': 'req-cc7f4414-faf6-4157-9e84-3458eb4b4f51'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.875866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:01.879893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] The token cache is being invalidate because project 08ccc5a670c049eda6e6f5b97b73ebec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:45:01.880321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.881371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:01.883207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1302/2600] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:45:01 2022] DELETE /identity/v3/projects/08ccc5a670c049eda6e6f5b97b73ebec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:01.886953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:01.889162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:01.902030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5073f1-1134-422d-b616-fa5901b0f2f4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:01.914722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:01.972207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:01.973267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:01.973267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:01.973455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] PATH_INFO: `/v3/users/bec2445085a84c49a38628d7e6b6fade` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:01.975021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec2445085a84c49a38628d7e6b6fade)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:01.976584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.036664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec2445085a84c49a38628d7e6b6fade'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.049676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec2445085a84c49a38628d7e6b6fade'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.050374 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec2445085a84c49a38628d7e6b6fade'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.057779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec2445085a84c49a38628d7e6b6fade'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.058429 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-09525a73-c9ec-45a0-8463-034c8257864c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec2445085a84c49a38628d7e6b6fade'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.071235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1299/2601] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:45:01 2022] DELETE /identity/v3/users/bec2445085a84c49a38628d7e6b6fade => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:45:02.247456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.248939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:02.262091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4414-faf6-4157-9e84-3458eb4b4f51 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.321390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.322028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.322305 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.322578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] PATH_INFO: `/v3/projects/71025fdcfbd442208b12121c25c645aa` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.323739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71025fdcfbd442208b12121c25c645aa)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.326398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.375239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71025fdcfbd442208b12121c25c645aa', 'request_id': 'req-4794245f-7005-4d21-875b-262176fa41b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.380957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71025fdcfbd442208b12121c25c645aa', 'request_id': 'req-4794245f-7005-4d21-875b-262176fa41b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.388927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71025fdcfbd442208b12121c25c645aa', 'request_id': 'req-4794245f-7005-4d21-875b-262176fa41b5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.400380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] The token cache is being invalidate because project 71025fdcfbd442208b12121c25c645aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:45:02.400667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.401386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4794245f-7005-4d21-875b-262176fa41b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:45:02.402903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1303/2602] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:45:02 2022] DELETE /identity/v3/projects/71025fdcfbd442208b12121c25c645aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:02.407980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.408473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.408606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.427874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:02.429084 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:02.487991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1300/2603] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:45:02.495640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.495928 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.496201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.518163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:02.519385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:02.527419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1304/2604] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:02.532238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.541951 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5f59-b6db-4770-8524-f85dd431c064 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.547331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.548631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.548958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.549164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.549807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:45:02.550109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.551719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.563612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1301/2605] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:45:02.568241 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.578680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb14d50-d90d-421f-bdfb-8c046da3e24b None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.583604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.584326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.584726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.584977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.585753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.587772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.623449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1305/2606] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:45:02 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:45:02.624875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.635760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadc3e3-e1aa-44e7-8dd5-dd29437db899 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.658479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:02.698787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.699732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.700163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.700437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.701049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.703287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.725956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1302/2607] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:45:02 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:45:02.730113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.742520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39ae44-f34b-41f1-b517-b76e8a71672d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.748006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.748606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.748893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.749160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.749831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.751427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.762852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1306/2608] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:45:02.766878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.777307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a832-fe32-4557-9a82-c05105fc1a53 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.782655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.783259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.783559 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.783847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.784697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.786300 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f68cbd-1565-4d85-bc14-28f3a82e1f69 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.797605 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1303/2609] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:45:02.802091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.812710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2067cb-fa6d-4233-b2e1-c81c3dba8a31 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:02.817434 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:02.818159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.818506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.819180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] PATH_INFO: `/v3/projects/e2604417eb5f48f0b026b00a9c164e08/users/73a4f1987dda43068520217d36d99799/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.835123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2604417eb5f48f0b026b00a9c164e08, user_id=73a4f1987dda43068520217d36d99799, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:02.837738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:02.852587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1307/2610] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:45:02 2022] PUT /identity/v3/projects/e2604417eb5f48f0b026b00a9c164e08/users/73a4f1987dda43068520217d36d99799/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:02.858106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe97c-0d4b-4679-908e-efe4726e376c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:02.858393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe97c-0d4b-4679-908e-efe4726e376c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:02.858667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe97c-0d4b-4679-908e-efe4726e376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:02.878290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-3adbe97c-0d4b-4679-908e-efe4726e376c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:02.879517 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3adbe97c-0d4b-4679-908e-efe4726e376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:02.943478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1304/2611] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:02.953413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:02.955138 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:02.986244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:03.014731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efa359-4091-4752-aebb-2d341eec665f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:03.018346 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:03.018939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:03.019215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:03.019483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:03.028902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:03.030311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:03.043877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1308/2612] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:45:07.489307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.489874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.489874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.519711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] MFA Rules not processed for user `73a4f1987dda43068520217d36d99799`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:07.520922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:07.598510 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1305/2613] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:07.602986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.613797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228c97a-baf6-42e1-9ffa-a5b3a1871f3b service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.618742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.619349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.619675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.619932 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.620733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.623225 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:07.653440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1309/2614] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:45:07 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:45:07.657532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.669043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb583a-407e-4584-8c88-2b7a384bb82d None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.701331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:07.732840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.733702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.734056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.734401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.735101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.737385 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:07.765836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1306/2615] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:45:07 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:45:07.769804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.782816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84e83-af54-4f08-b856-e3226ee5e79b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.788125 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.788730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.789016 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.789290 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.789935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.791776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:07.803426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1310/2616] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:45:07.807698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.818913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dbb95-5d83-48d4-9417-c490ca3201a8 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.824930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.825635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.825912 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.826186 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] PATH_INFO: `/v3/projects/881e81e98074458d9cd4ddd43f67d851/users/3109516109494a4f8749bd1addf2ca2d/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.843060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=881e81e98074458d9cd4ddd43f67d851, user_id=3109516109494a4f8749bd1addf2ca2d, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.845722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:07.862518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1307/2617] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:45:07 2022] PUT /identity/v3/projects/881e81e98074458d9cd4ddd43f67d851/users/3109516109494a4f8749bd1addf2ca2d/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:07.867618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.882429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e22-8795-4645-9719-8174bc3b9dd8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.948825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.949409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.949886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.950163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.950892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.952795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d58ac-6402-4ac8-b48e-bab5e093f7a7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:07.968538 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1311/2618] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:45:07.972648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:07.984232 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ce398-dbcf-4dda-81a9-185ca3860c4a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:07.988952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:07.989615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:07.989897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:07.990177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] PATH_INFO: `/v3/projects/881e81e98074458d9cd4ddd43f67d851/users/3109516109494a4f8749bd1addf2ca2d/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:07.992120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881e81e98074458d9cd4ddd43f67d851, user_id=3109516109494a4f8749bd1addf2ca2d, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:07.994772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:08.009981 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1308/2619] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:45:07 2022] PUT /identity/v3/projects/881e81e98074458d9cd4ddd43f67d851/users/3109516109494a4f8749bd1addf2ca2d/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:45:12.756852 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad751-e5e3-4d63-8d0b-a7ad6da61394 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:12.757922 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad751-e5e3-4d63-8d0b-a7ad6da61394 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:12.758994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad751-e5e3-4d63-8d0b-a7ad6da61394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:12.795176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-94fad751-e5e3-4d63-8d0b-a7ad6da61394 None None] MFA Rules not processed for user `3109516109494a4f8749bd1addf2ca2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:12.796779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-94fad751-e5e3-4d63-8d0b-a7ad6da61394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:12.886135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1312/2620] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:12.904990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:12.906771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:12.999106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c23c-6959-45a4-8495-37e2e1ca79a6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:13.007309 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:13.008003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:13.008285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:13.008560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:13.073564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:13.076108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:13.086034 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1309/2621] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:45:22.884123 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:23.081533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:29.321068 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b57-7755-402d-917f-2cba7501af41 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:29.321588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b57-7755-402d-917f-2cba7501af41 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:29.321696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba850b57-7755-402d-917f-2cba7501af41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:29.340282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ba850b57-7755-402d-917f-2cba7501af41 None None] MFA Rules not processed for user `73a4f1987dda43068520217d36d99799`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:29.341969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ba850b57-7755-402d-917f-2cba7501af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:29.348768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1313/2622] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:39.335733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:46.787121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:45:46.842701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361aa1-1236-481e-8fc7-dd29efd0cc46 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:45:46.846417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:45:46.847021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:46.847321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:46.847623 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:46.856773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:45:46.858195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc36e0a-ff1b-4f98-a165-2ed654c1ef60 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:45:46.867800 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1310/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:45:48.610718 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2e32e-14e2-4dc4-a424-c27e9f6c3fdc None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:45:48.611127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2e32e-14e2-4dc4-a424-c27e9f6c3fdc None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:45:48.611249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2e32e-14e2-4dc4-a424-c27e9f6c3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:45:48.643954 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5ed2e32e-14e2-4dc4-a424-c27e9f6c3fdc None None] MFA Rules not processed for user `d586af36267c475ab5af42a23ce3f1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:45:48.645158 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5ed2e32e-14e2-4dc4-a424-c27e9f6c3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:45:48.731945 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1314/2624] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:45:56.863459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=26 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:58.725534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=37 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:06.698681 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:46:06.699178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:46:06.699438 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:46:06.719508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] MFA Rules not processed for user `49114d25c04144269e3eb88448e2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:46:06.720756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:46:06.773890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1311/2625] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:46:16.767287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=25 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:57.872149 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:46:57.872663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:46:57.872663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:46:57.901399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:46:57.902589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:46:57.979462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1315/2626] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:46:58.024653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:46:58.026068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:46:58.102496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167ce5-1d5a-483f-8d16-533663572a42 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:46:58.107409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:46:58.108043 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:46:58.108325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:46:58.108601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:46:58.117183 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:46:58.118792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb40034-ebf2-47c6-a402-c47a539dde37 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:46:58.126734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1312/2627] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:46:58.554431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:46:58.556513 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:46:58.691185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17222-9f29-4743-8b68-8451fa954f22 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:46:58.697637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:46:58.698380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:46:58.698762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:46:58.699146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:46:58.701454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:46:58.727986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:46:58.731694 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897480b-4e17-4a86-b6a9-cbfec2e30926 service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:46:58.750504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1316/2628] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:46:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:47:08.123646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=35 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:08.750658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=80 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:10.536319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:10.536846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:10.536846 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] PATH_INFO: `/` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:10.538207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1313/2629] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 17 08:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 08:47:10.543160 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88254-da3e-4e49-8089-d024e8266bf2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:10.543623 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88254-da3e-4e49-8089-d024e8266bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:10.543823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88254-da3e-4e49-8089-d024e8266bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:10.588215 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-87f88254-da3e-4e49-8089-d024e8266bf2 None None] MFA Rules not processed for user `6e110ca44c21448c807e788a08126a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:47:10.589446 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-87f88254-da3e-4e49-8089-d024e8266bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:10.608898 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1317/2630] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 17 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:47:10.620711 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:47:10.622387 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:10.680701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b683-b69e-4f13-8a19-bb5c2c46dcf1 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:47:10.684827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:47:10.685434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:10.685714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:10.685988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:10.696011 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:47:10.698042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:47:10.708808 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1314/2631] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:47:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:47:12.543260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aca09-bd00-46da-aae0-4881aee93d48 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:12.543767 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aca09-bd00-46da-aae0-4881aee93d48 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:12.543863 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aca09-bd00-46da-aae0-4881aee93d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:12.563313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-671aca09-bd00-46da-aae0-4881aee93d48 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:47:12.564556 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-671aca09-bd00-46da-aae0-4881aee93d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:12.571969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1318/2632] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:47:12.584035 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:47:12.595373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87007a-148d-4e9d-8fae-97e6a796589e service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:47:12.600267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:47:12.600857 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:12.601132 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:12.601402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:12.610108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:47:12.611708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:47:12.620368 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1315/2633] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:47:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:47:22.558614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=19 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:22.616413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=32 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:22.643018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce62e-7332-4f16-a07a-ccc9a0158dd2 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:22.643299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce62e-7332-4f16-a07a-ccc9a0158dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:22.643594 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ce62e-7332-4f16-a07a-ccc9a0158dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:22.662399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-db4ce62e-7332-4f16-a07a-ccc9a0158dd2 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:47:22.663633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-db4ce62e-7332-4f16-a07a-ccc9a0158dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:22.671216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1319/2634] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:47:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:47:22.683692 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:47:22.694199 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644129a5-7d71-4e34-83be-ce935c0193d1 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:47:22.700005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:47:22.700592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:22.700866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:22.701135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:22.708908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:47:22.710455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:47:22.718250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1316/2635] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:47:32.657788 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:32.715104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=6 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:37.988851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:37.989451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:37.989451 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:38.008447 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] MFA Rules not processed for user `49114d25c04144269e3eb88448e2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:47:38.009693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:38.016492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1320/2636] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:47:42.313055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:47:42.332740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea8fce-de90-4d5d-854a-5dd7757978ea service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:47:42.336963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:47:42.337555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:42.337836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:42.338109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:42.339858 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:42.353346 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:47:42.354749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc334ea-1616-41e2-b5f1-4e74d33c9e14 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:47:42.365529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1317/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:47:45.869179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:47:45.870633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:45.894705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86579de-c69c-48a3-8751-5675be5dc9df None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:47:45.898183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:47:45.898773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:45.899046 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:45.899309 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:45.901536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:45.914506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:47:45.916540 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:47:45.927210 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1321/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:47:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:47:49.883320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:47:49.884532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:47:49.884532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:47:49.904845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] MFA Rules not processed for user `73a4f1987dda43068520217d36d99799`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:47:49.906302 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:47:49.913725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1318/2639] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:47:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:47:55.922483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=14 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:59.898417 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=13 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:06.904223 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:06.908746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:07.011371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1879e1-a784-4a6c-9478-715f18bccf04 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:07.016031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:07.016662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.016941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.017216 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] PATH_INFO: `/v3/users/d586af36267c475ab5af42a23ce3f1b1` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.018348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d586af36267c475ab5af42a23ce3f1b1)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:07.020367 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:07.069288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd586af36267c475ab5af42a23ce3f1b1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.081359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd586af36267c475ab5af42a23ce3f1b1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.089406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd586af36267c475ab5af42a23ce3f1b1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.090043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd586af36267c475ab5af42a23ce3f1b1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.097187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d5da031-716c-4deb-b3fe-4116241a0d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd586af36267c475ab5af42a23ce3f1b1'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.103711 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1322/2640] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:06 2022] DELETE /identity/v3/users/d586af36267c475ab5af42a23ce3f1b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:07.423062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:07.434078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f758caf-3c4b-49e5-8c53-7595cafa9798 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:07.495629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:07.496270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.496556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.496831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] PATH_INFO: `/v3/projects/eb857c94e3f6405baad84dfc45445b0d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.497953 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb857c94e3f6405baad84dfc45445b0d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:07.499983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:07.546612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb857c94e3f6405baad84dfc45445b0d', 'request_id': 'req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.552026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb857c94e3f6405baad84dfc45445b0d', 'request_id': 'req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.560397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb857c94e3f6405baad84dfc45445b0d', 'request_id': 'req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.573522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] The token cache is being invalidate because project eb857c94e3f6405baad84dfc45445b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:07.574178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.574868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-6ae2d95b-7b51-4001-8d4c-b4f6b2236e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:07.576561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1319/2641] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:07 2022] DELETE /identity/v3/projects/eb857c94e3f6405baad84dfc45445b0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:07.581949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.582368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.582731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.635845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:07.637196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:07.661760 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:07.700969 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1323/2642] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:07.708775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.709062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.709339 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.730099 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:07.731306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:07.739441 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1320/2643] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:07.744022 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:07.753830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e4d89-0201-4c4d-bcc0-10d0a9725755 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:07.758464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:07.759071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.759348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.759650 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.760353 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:07.760656 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:07.762251 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:07.773989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1324/2644] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:48:07.778213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:07.787523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2fa07-66b2-4f02-bd27-5ae10ef78f86 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:07.792773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:07.793375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:07.793655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:07.793926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:07.794552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:07.796529 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:07.956697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1321/2645] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:07 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:07.960854 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:07.971466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554fad-30ae-420f-99be-b3fad8d71262 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.028901 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.029511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.029791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.030091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.030724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.032691 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.055654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1325/2646] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:07 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:08.059815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.070451 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000f0f-4e60-4aa5-8104-6d40072036a6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.075504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.076169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.076448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.076718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.077355 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.078950 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.088952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1322/2647] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:08.092956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.103474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c25b2c-0fd5-4972-8451-19ff0d049be9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.108064 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.108658 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.108933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.109201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.109845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.111430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658318-2157-43f2-8fe8-03f6c817a340 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.122560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1326/2648] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:08.126723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.136722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69733-bd2b-4d05-be37-b0dba987f17e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.141460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.142175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.142521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.142869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] PATH_INFO: `/v3/projects/6d6b9278c92d4c34964bda5373b73287/users/9d8735144fc945698f277c6593bfa9e5/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.158518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6b9278c92d4c34964bda5373b73287, user_id=9d8735144fc945698f277c6593bfa9e5, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.161363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.175277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1323/2649] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:08 2022] PUT /identity/v3/projects/6d6b9278c92d4c34964bda5373b73287/users/9d8735144fc945698f277c6593bfa9e5/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:08.185681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.186108 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.186380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.214385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] MFA Rules not processed for user `9d8735144fc945698f277c6593bfa9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:08.215641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:08.282958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1327/2650] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:08.287432 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.308411 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:08.354096 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c39f6-82b1-4fda-b932-fed3fb2b6887 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.358726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.359324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.359629 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.359898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.360508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.362375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.394446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1324/2651] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:08.395523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.406424 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87b76c-6aad-4252-9d06-6f6d5e059698 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.426828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:08.468104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.468717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.469003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.469274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.469904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.471844 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.498104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1328/2652] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:08 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:08.499295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.509663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227c65-7df1-423d-9636-5f5ca389b4e9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.514305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.514970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.515332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.515938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.516653 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.518737 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.528713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1325/2653] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:08.533026 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.543776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcee50-4a66-4dc8-8dac-2edd5f0e832c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.548433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.549154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.549581 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.549912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] PATH_INFO: `/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a/users/78aed83fce494c29a3d4974c36777f2a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.565510 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4549c854be4f4810b7c6fbb85c14aa9a, user_id=78aed83fce494c29a3d4974c36777f2a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.568200 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.581569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1329/2654] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:08 2022] PUT /identity/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a/users/78aed83fce494c29a3d4974c36777f2a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:08.585768 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.599704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df683c4-3440-4271-bb90-749dc678e034 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.659652 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.660562 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.660842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.661115 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.661753 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.663327 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7df35-ed81-4921-aa3a-fc719721a88f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.673040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1326/2655] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:08.677416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.688007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641494c-6aac-4308-bca8-15f70bf74c16 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.692595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.693245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.693521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.694153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] PATH_INFO: `/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a/users/78aed83fce494c29a3d4974c36777f2a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.696429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4549c854be4f4810b7c6fbb85c14aa9a, user_id=78aed83fce494c29a3d4974c36777f2a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.699347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.716081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1330/2656] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:08 2022] PUT /identity/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a/users/78aed83fce494c29a3d4974c36777f2a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:08.728257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.728622 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.728980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.759779 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] MFA Rules not processed for user `78aed83fce494c29a3d4974c36777f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:08.761127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:08.839802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1327/2657] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:08.851211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.853486 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:08.878485 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:08.880521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:08.896667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:08.945830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d245-cf59-4977-a591-f5da3d139c3e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.949609 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878d18-05c7-4959-b46f-8f4f806f9f02 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:08.950471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.951159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.951479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.951755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.955645 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:08.956363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:08.956732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:08.957097 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:08.959196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:08.962497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.964003 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.973316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:08.974228 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1331/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:08.974977 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:08.987877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1328/2659] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:09.054908 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:09.064204 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5b67-65d1-488d-86be-db1dd9c331a9 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:09.068176 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:09.069222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:09.069222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:09.069708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:09.133401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:09.135282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05961e4-2c55-4940-b0d4-59ef6e24062f service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:09.139201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:09.147906 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1332/2660] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:18.981363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=20 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:19.150474 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:47.398391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:47.460277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05a1b-4759-40fa-b131-f47c1594f44f service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:47.464937 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:47.465551 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:47.465824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:47.466102 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] PATH_INFO: `/v3/users/9d8735144fc945698f277c6593bfa9e5` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:47.467193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8735144fc945698f277c6593bfa9e5)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:47.469109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:47.514014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8735144fc945698f277c6593bfa9e5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:47.525504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8735144fc945698f277c6593bfa9e5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:47.526154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8735144fc945698f277c6593bfa9e5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:47.533126 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8735144fc945698f277c6593bfa9e5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:47.533735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8735144fc945698f277c6593bfa9e5'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:47.545996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1329/2661] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:47 2022] DELETE /identity/v3/users/9d8735144fc945698f277c6593bfa9e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:47.550409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:47.550923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:47.550923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:47.575422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:47.576700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:47.650089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1333/2662] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:47.651873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:47.653308 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:47.658738 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:47.660086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:47.710391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bf9c5-e270-4791-94d3-2147932aec25 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:47.714184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:47.714825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:47.715125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:47.715395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:47.716726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00e37-5a76-43d1-81c0-c3c970964eae None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:47.717323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:47.720439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:47.721027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:47.721300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:47.721566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:47.729478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:47.730516 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:47.730886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:47.731988 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:47.740980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1330/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:47.741365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1334/2664] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:48.210337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:48.212391 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:48.229786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a581cd5-4da7-4753-b74b-492c54a2bb0e service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:48.234830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:48.235482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:48.235780 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:48.236144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] PATH_INFO: `/v3/projects/6d6b9278c92d4c34964bda5373b73287` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:48.237520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6b9278c92d4c34964bda5373b73287)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:48.240168 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:48.260089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:48.292077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6b9278c92d4c34964bda5373b73287', 'request_id': 'req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.297922 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6b9278c92d4c34964bda5373b73287', 'request_id': 'req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.306331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6b9278c92d4c34964bda5373b73287', 'request_id': 'req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.317971 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] The token cache is being invalidate because project 6d6b9278c92d4c34964bda5373b73287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:48.318252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.318892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.323690 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1331/2665] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:48 2022] DELETE /identity/v3/projects/6d6b9278c92d4c34964bda5373b73287 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:48.324708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:48.334420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23953-f11c-4b21-bd23-a3cc55215d6e service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:48.391963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:48.392598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:48.392874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:48.393174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] PATH_INFO: `/v3/users/78aed83fce494c29a3d4974c36777f2a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:48.394692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=78aed83fce494c29a3d4974c36777f2a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:48.396682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:48.448690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:48.450792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78aed83fce494c29a3d4974c36777f2a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.468187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78aed83fce494c29a3d4974c36777f2a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.477722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78aed83fce494c29a3d4974c36777f2a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.478478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78aed83fce494c29a3d4974c36777f2a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.486838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-220edfec-643b-4887-84e4-99f0eeab00ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78aed83fce494c29a3d4974c36777f2a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:48.495157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1335/2666] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:48 2022] DELETE /identity/v3/users/78aed83fce494c29a3d4974c36777f2a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:49.256304 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.258224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:49.272527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b93f9-d4dc-4db2-b40d-b56b72a50cb6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.333663 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.334393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.334666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.334934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] PATH_INFO: `/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.336130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4549c854be4f4810b7c6fbb85c14aa9a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.338009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.385188 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4549c854be4f4810b7c6fbb85c14aa9a', 'request_id': 'req-0d12f032-6fcd-419b-9a48-32a2509e8ce6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:49.390958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4549c854be4f4810b7c6fbb85c14aa9a', 'request_id': 'req-0d12f032-6fcd-419b-9a48-32a2509e8ce6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:49.400013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4549c854be4f4810b7c6fbb85c14aa9a', 'request_id': 'req-0d12f032-6fcd-419b-9a48-32a2509e8ce6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:49.411178 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] The token cache is being invalidate because project 4549c854be4f4810b7c6fbb85c14aa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:49.411462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:49.412106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0d12f032-6fcd-419b-9a48-32a2509e8ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:49.413618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1332/2667] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:49 2022] DELETE /identity/v3/projects/4549c854be4f4810b7c6fbb85c14aa9a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:49.418654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.419129 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.419235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.438739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:49.440075 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:49.503329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1336/2668] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:49.511819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.512103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.512375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.532190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:49.533395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:49.541597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1333/2669] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:49.545802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.555860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2272022-413f-4caf-83f0-9d99a7e87a86 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.561174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.561782 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.562062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.562333 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.562982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:49.563282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.564907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.581531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1337/2670] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:48:49.582557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.592832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34c49e-35b0-4e91-a2ba-7ff774e59656 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.598138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.598743 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.599052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.599323 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.599998 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.602486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.639831 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1334/2671] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:49 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:49.643950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.654762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e0a7d-e172-4261-a0b2-55bec3b587f7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.728693 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.729310 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.730211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.730211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.730531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.732666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.760288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1338/2672] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:49 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:49.762439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.775646 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f94501-caa3-4bfb-a024-a5e16ae1e2ad admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.781745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.782480 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.782861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.783740 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.784684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.786556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.788247 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:49.806378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1335/2673] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:49.810332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.820930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e81e-9546-4ab9-a866-dbb773d32c61 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.826130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.826815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.827194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.827585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.828317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.830021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abdf1a-0184-410c-af8f-871fc7509948 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.843190 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1339/2674] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:49.847698 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:49.858271 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be03ad-465c-4ab4-ab6c-c6df7fa49b4e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:49.863353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:49.864041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.864319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.864599 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] PATH_INFO: `/v3/projects/b0d736149b8741009547cc008dd6bda4/users/211761cf57874719aa1d9ae254e7132b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.883373 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d736149b8741009547cc008dd6bda4, user_id=211761cf57874719aa1d9ae254e7132b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:49.886375 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:49.902284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1336/2675] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:49 2022] PUT /identity/v3/projects/b0d736149b8741009547cc008dd6bda4/users/211761cf57874719aa1d9ae254e7132b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:49.913651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:49.914808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:49.915085 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:49.946070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] MFA Rules not processed for user `211761cf57874719aa1d9ae254e7132b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:49.946816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:49.965326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:50.025986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1340/2676] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:50.030463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.111351 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5eb4-8a0f-4afa-af7c-703626c46031 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.118591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.119330 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.119736 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.120069 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.120874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.122999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.159784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1337/2677] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:50 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:50.164777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.182070 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ec61-6662-4953-a8df-d8f5e467c66f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.243809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.244426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.244707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.244978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.245603 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.247520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.271505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1341/2678] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:50 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:50.275555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.285987 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08983905-20f7-4c90-a511-f1edb89292fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.291144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.291763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.292039 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.292306 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.292942 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.294518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.305471 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1338/2679] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:50.309770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.320043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd14d-9d9e-47d2-871c-6388873d2eb5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.325770 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.326419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.326697 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.326970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] PATH_INFO: `/v3/projects/41d64063a969489c94ba0659e89662e3/users/5277b7bfe4b94bdf9b8bf80a20b05048/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.343670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d64063a969489c94ba0659e89662e3, user_id=5277b7bfe4b94bdf9b8bf80a20b05048, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.346318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.359997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1342/2680] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:50 2022] PUT /identity/v3/projects/41d64063a969489c94ba0659e89662e3/users/5277b7bfe4b94bdf9b8bf80a20b05048/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:50.364189 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.374088 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a603e1-5709-474c-8184-9ddf0657126d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.437408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.438024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.438303 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.438571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.439208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.440825 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0fa6-0281-4429-856c-597e1734c02b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.452027 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1339/2681] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:50.456398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.467529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030149-3b33-4ea0-94a8-d5e469f73f12 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.472717 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.473374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.474244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.474523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] PATH_INFO: `/v3/projects/41d64063a969489c94ba0659e89662e3/users/5277b7bfe4b94bdf9b8bf80a20b05048/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.476653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d64063a969489c94ba0659e89662e3, user_id=5277b7bfe4b94bdf9b8bf80a20b05048, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.479293 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.489655 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1343/2682] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:50 2022] PUT /identity/v3/projects/41d64063a969489c94ba0659e89662e3/users/5277b7bfe4b94bdf9b8bf80a20b05048/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:50.500611 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.500882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.501160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.530861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] MFA Rules not processed for user `5277b7bfe4b94bdf9b8bf80a20b05048`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:50.532343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:50.566108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:50.613560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1340/2683] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:50.628942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.630790 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:50.728171 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ebb2-8388-4b4c-85dc-8ade35f89cd8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.732580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.733189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.733464 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.733729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.744459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.745871 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501c24a-f4fa-478f-9f7e-28d52f931708 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.756363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1344/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:50.793677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:50.870726 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea84fb-de41-4f06-a395-b6a92f476d6a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:50.875353 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:50.876016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.876299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.876569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] PATH_INFO: `/v3/users/211761cf57874719aa1d9ae254e7132b` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:50.877696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=211761cf57874719aa1d9ae254e7132b)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:50.879620 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:50.930540 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211761cf57874719aa1d9ae254e7132b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:50.946495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211761cf57874719aa1d9ae254e7132b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:50.947200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211761cf57874719aa1d9ae254e7132b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:50.955121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211761cf57874719aa1d9ae254e7132b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:50.955837 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211761cf57874719aa1d9ae254e7132b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:50.980142 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1341/2685] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:50 2022] DELETE /identity/v3/users/211761cf57874719aa1d9ae254e7132b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:50.982865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404089-490f-4f86-b132-1fa465fda28f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:50.983146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404089-490f-4f86-b132-1fa465fda28f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:50.983445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404089-490f-4f86-b132-1fa465fda28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.022154 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-03404089-490f-4f86-b132-1fa465fda28f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:51.023437 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-03404089-490f-4f86-b132-1fa465fda28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.035140 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:51.109578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1345/2686] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:51.119402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.121396 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.211754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:51.218321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c290f0b-f21f-40e5-abfe-415d008d65cb admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.226274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.226274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.226274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.226274 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.238688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.240796 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.251996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1342/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:51.332209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03404089-490f-4f86-b132-1fa465fda28f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.333661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-03404089-490f-4f86-b132-1fa465fda28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.348769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03404089-490f-4f86-b132-1fa465fda28f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.354469 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.355117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.355397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.355724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] PATH_INFO: `/v3/users/49114d25c04144269e3eb88448e2c2ee` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.358245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49114d25c04144269e3eb88448e2c2ee)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.360276 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.425345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49114d25c04144269e3eb88448e2c2ee'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.441574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49114d25c04144269e3eb88448e2c2ee'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.452453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49114d25c04144269e3eb88448e2c2ee'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.453528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49114d25c04144269e3eb88448e2c2ee'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.461416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49114d25c04144269e3eb88448e2c2ee'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.469286 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1346/2688] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:51 2022] DELETE /identity/v3/users/49114d25c04144269e3eb88448e2c2ee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:51.565479 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.567516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.582963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050fbf3-bdd7-40dc-a29c-075e7f3332cb service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.645769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.646428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.646713 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.647012 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] PATH_INFO: `/v3/projects/b0d736149b8741009547cc008dd6bda4` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.648310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d736149b8741009547cc008dd6bda4)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.650988 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.657031 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.658521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.673943 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852acab-f298-47e1-9979-d846c25a631b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.678884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.679688 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.679967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.680360 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] PATH_INFO: `/v3/projects/34b106e46b2c4fb292353a6176c9f699` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.681549 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b106e46b2c4fb292353a6176c9f699)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.683493 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.703424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d736149b8741009547cc008dd6bda4', 'request_id': 'req-2592763e-dfb9-49a0-87a2-20c9e16cace9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.709149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d736149b8741009547cc008dd6bda4', 'request_id': 'req-2592763e-dfb9-49a0-87a2-20c9e16cace9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.718697 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d736149b8741009547cc008dd6bda4', 'request_id': 'req-2592763e-dfb9-49a0-87a2-20c9e16cace9'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.730200 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] The token cache is being invalidate because project b0d736149b8741009547cc008dd6bda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:51.730596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.731228 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.732771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1343/2689] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:51 2022] DELETE /identity/v3/projects/b0d736149b8741009547cc008dd6bda4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:51.734904 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b106e46b2c4fb292353a6176c9f699', 'request_id': 'req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.736500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.737948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.740836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b106e46b2c4fb292353a6176c9f699', 'request_id': 'req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.749315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b106e46b2c4fb292353a6176c9f699', 'request_id': 'req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.761986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] The token cache is being invalidate because project 34b106e46b2c4fb292353a6176c9f699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:51.762378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.763035 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-a8bfefa2-1c4a-4c51-847b-8b30cee0b7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.764587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1347/2690] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:51 2022] DELETE /identity/v3/projects/34b106e46b2c4fb292353a6176c9f699 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:51.769373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83933da-6298-45bb-adf8-9913678c041e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.769836 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83933da-6298-45bb-adf8-9913678c041e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.770112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83933da-6298-45bb-adf8-9913678c041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.789874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b83933da-6298-45bb-adf8-9913678c041e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:51.791076 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b83933da-6298-45bb-adf8-9913678c041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.795265 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:51.803042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592763e-dfb9-49a0-87a2-20c9e16cace9 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.829483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:51.854749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1348/2691] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:51.862357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.862639 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.862911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.863463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.864127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.864402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.864672 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] PATH_INFO: `/v3/users/5277b7bfe4b94bdf9b8bf80a20b05048` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.865795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5277b7bfe4b94bdf9b8bf80a20b05048)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.867749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.881785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:51.883690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.891506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1349/2692] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:51.895893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.906242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c12c9-bf69-486f-9a76-631089844edf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.910833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.911427 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.911816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.912156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.912789 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:51.913086 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.914712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.915756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5277b7bfe4b94bdf9b8bf80a20b05048'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.926127 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1350/2693] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:48:51.928539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5277b7bfe4b94bdf9b8bf80a20b05048'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.929245 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5277b7bfe4b94bdf9b8bf80a20b05048'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.930733 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:51.932365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:51.938775 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5277b7bfe4b94bdf9b8bf80a20b05048'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.939462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5277b7bfe4b94bdf9b8bf80a20b05048'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:51.945985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc977703-3e06-47dd-b998-3a185ba8b98d admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:51.951185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:51.951801 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:51.952077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:51.952345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:51.952950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:51.953545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1344/2694] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:51 2022] DELETE /identity/v3/users/5277b7bfe4b94bdf9b8bf80a20b05048 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:51.954821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:51.985334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1351/2695] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:51 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:51.986617 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.049032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252858c-2e36-44f0-be9e-63971c386d70 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.102158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:52.115329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.116057 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.116569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.116878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.118119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.120213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.144666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1345/2696] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:51 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:52.149018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.159628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36025bb5-a959-4af8-b41a-beb42c45d1c0 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.164580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.165185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.165462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.165732 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.166374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.167998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.179456 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1352/2697] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:52.184195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.194397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e2f0-3b13-4bd2-a06c-2586697d1b18 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.199959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.200567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.200848 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.201122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.201770 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.203358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.214220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1346/2698] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:52.218514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.229442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83d8ed-925b-42e5-b7d7-51720b3411bf admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.234357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.235020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.235300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.235724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] PATH_INFO: `/v3/projects/9d389a7bc00d4acc841ded544a1a520a/users/03fe6eb615ac4c44b5282c00dce8215d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.235856 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.237827 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.252924 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd06a-9768-436c-9554-a1887ee61203 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.257539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.258734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.259010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.259282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] PATH_INFO: `/v3/projects/41d64063a969489c94ba0659e89662e3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.261111 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d64063a969489c94ba0659e89662e3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.263705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.269856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d389a7bc00d4acc841ded544a1a520a, user_id=03fe6eb615ac4c44b5282c00dce8215d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.272668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d499d-bc03-4a73-9aff-da83b41a1c03 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.286416 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1353/2699] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:52 2022] PUT /identity/v3/projects/9d389a7bc00d4acc841ded544a1a520a/users/03fe6eb615ac4c44b5282c00dce8215d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:52.298722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.299010 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.299288 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.313963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d64063a969489c94ba0659e89662e3', 'request_id': 'req-011f131b-5810-4ca7-a60a-9bbc82c25934'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:52.319925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d64063a969489c94ba0659e89662e3', 'request_id': 'req-011f131b-5810-4ca7-a60a-9bbc82c25934'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:52.328781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d64063a969489c94ba0659e89662e3', 'request_id': 'req-011f131b-5810-4ca7-a60a-9bbc82c25934'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:52.329072 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] MFA Rules not processed for user `03fe6eb615ac4c44b5282c00dce8215d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:52.330357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.341556 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] The token cache is being invalidate because project 41d64063a969489c94ba0659e89662e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:52.341842 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:52.342491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-011f131b-5810-4ca7-a60a-9bbc82c25934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:52.344146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1347/2700] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:52 2022] DELETE /identity/v3/projects/41d64063a969489c94ba0659e89662e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:52.348570 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6157ee-a820-4de5-a952-0fcc519b7edf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.348850 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6157ee-a820-4de5-a952-0fcc519b7edf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.349121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6157ee-a820-4de5-a952-0fcc519b7edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.368680 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cf6157ee-a820-4de5-a952-0fcc519b7edf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:52.369898 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cf6157ee-a820-4de5-a952-0fcc519b7edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.396400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1354/2701] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:52.401412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.402845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.428081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:52.429324 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1348/2702] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:52.438600 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.438889 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.439163 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.458415 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:52.459655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.468307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1349/2703] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:52.469593 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42896-3c52-4f91-a792-6b29f5e98f3e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.472359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.474235 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.474832 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.475104 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.475371 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.476042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.477947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.481333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387446-fc21-4d3b-9194-4af7de255b2c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.485943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.486523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.486793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.487060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.487720 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:52.488016 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.489560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.501748 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1350/2704] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:48:52.507038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1355/2705] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:52.507195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.508926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.516601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8551f4-d8cd-472d-b3ed-d8f5ea03c9d3 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.548809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:52.573716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d235b-b2e7-4fc7-b927-c6ea73812104 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.575067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.575705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.575982 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.576252 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.576869 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.578921 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.579071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.579520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.579823 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.580090 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.580700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.582569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.609068 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1351/2706] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:52.610105 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1356/2707] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:52.613292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.613800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.624401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd097-b608-475b-ae46-090b4446fc46 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.683307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a3a69-7fc4-4430-afac-df6b8c55b191 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.689724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.690425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.690771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.691141 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.691871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.693851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.696392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.697073 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.697343 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.697877 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.698517 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.700246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.712443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1357/2708] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:52.716314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.719152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1352/2709] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:52.723772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.727566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3bb1-e365-4845-b801-17e6c3e67854 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.732318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.732941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.733189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.733484 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.734121 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.735501 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66243-0756-4781-9aec-df80ca19f123 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.735739 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.740876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.741478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.741757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.742064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.742718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.744337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.747643 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1358/2710] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:52.751728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.756606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1353/2711] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:52.759086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.762205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375310d8-6597-4144-81c7-ab901965dbfd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.766893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.767533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.767838 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.768109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] PATH_INFO: `/v3/projects/41f2a8bb8bbd498ba9ec13e286f397b7/users/9e6d6bc9845940bb8530ee32b1ab1476/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.768863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e2758-3cea-4bc8-b9b7-68cd0d3b6b62 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.774152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.774787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.775121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.775399 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.776067 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.777637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.783559 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f2a8bb8bbd498ba9ec13e286f397b7, user_id=9e6d6bc9845940bb8530ee32b1ab1476, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.786197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9b382-0654-447a-86c8-6d57031b718d admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.788591 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1354/2712] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:52.793061 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.797880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:52.803920 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c758a-3fc4-4107-8200-a59b52f7185a admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.804093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1359/2713] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:52 2022] PUT /identity/v3/projects/41f2a8bb8bbd498ba9ec13e286f397b7/users/9e6d6bc9845940bb8530ee32b1ab1476/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:52.814222 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef885fd-acf3-4a0d-ad1d-d5b13779ff70 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.814578 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef885fd-acf3-4a0d-ad1d-d5b13779ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.814814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef885fd-acf3-4a0d-ad1d-d5b13779ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.842388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-aef885fd-acf3-4a0d-ad1d-d5b13779ff70 None None] MFA Rules not processed for user `9e6d6bc9845940bb8530ee32b1ab1476`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:52.843642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-aef885fd-acf3-4a0d-ad1d-d5b13779ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.861137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.861730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.862009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.862285 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] PATH_INFO: `/v3/projects/c21037a9558d4e97ac520189772a1e21/users/171ba5bf24d04c63b6734e81b36f274a/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.876833 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21037a9558d4e97ac520189772a1e21, user_id=171ba5bf24d04c63b6734e81b36f274a, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.879455 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:52.892867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1355/2714] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:52 2022] PUT /identity/v3/projects/c21037a9558d4e97ac520189772a1e21/users/171ba5bf24d04c63b6734e81b36f274a/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:52.913155 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1360/2715] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:52.918671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:52.933463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:52.960432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.960714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.961093 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.986715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b34164-8422-4933-93b6-6078b6aa6e7b admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:52.989457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] MFA Rules not processed for user `171ba5bf24d04c63b6734e81b36f274a`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:52.990654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:52.991462 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:52.992606 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:52.992882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:52.993158 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:52.993790 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:52.995685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.022631 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1356/2716] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:53.026594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.060048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1361/2717] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:53.064586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.077669 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6db94-775c-4ddc-9295-4f0c41fcdc28 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.089524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60145-5dc1-41a6-9735-079e8e63a3f6 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.094254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.094931 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.095209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.095487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.096139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.098085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.120861 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1357/2718] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:53 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:53.124634 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.133990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4846-8e35-453a-aca7-c6d5ba402770 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.138544 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.138721 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.139118 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.139282 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.139392 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.139596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.139721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.139869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.140295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.140492 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.141851 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.142364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.152714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1358/2719] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:53.156952 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.167496 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38bcd-923b-49e2-b255-8cad0775133c admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.169179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1362/2720] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:53 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:53.173107 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.176949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:53.228914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.229678 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.229840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.230109 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] PATH_INFO: `/v3/projects/eab9a53e39f04138a252fe81206f175f/users/41713297e55d4181a22957424571aae5/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.238078 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d49440-b2c9-4991-8013-0f4dc61cfb86 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.244029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.244637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.244909 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.245179 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.245795 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.247049 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab9a53e39f04138a252fe81206f175f, user_id=41713297e55d4181a22957424571aae5, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.247726 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.249729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.258677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:53.264407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1359/2721] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:53 2022] PUT /identity/v3/projects/eab9a53e39f04138a252fe81206f175f/users/41713297e55d4181a22957424571aae5/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:53.269179 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.272771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1363/2722] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:53 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:53.276384 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.285851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e83d3-4970-4d12-9ab6-ccb256183cad admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.333946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b249b2-02da-4ad6-bb7b-25db6ce8fb26 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.339234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.339870 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.340146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.340413 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.341040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.342695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.344452 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.345146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.345487 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.345819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.346522 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.348181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.352446 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1360/2723] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:53.356453 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.357961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1364/2724] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:53.362153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.365897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3f67b-1a02-4598-81e1-6f1d64043e58 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.370435 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.371125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.371336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.371632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] PATH_INFO: `/v3/projects/eab9a53e39f04138a252fe81206f175f/users/41713297e55d4181a22957424571aae5/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.372335 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccda9c-783e-4334-8935-a1d9c9e8cc47 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.373493 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab9a53e39f04138a252fe81206f175f, user_id=41713297e55d4181a22957424571aae5, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.376122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b827ccd-749b-4c9f-a067-bccf8ec0d175 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.376900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.377532 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.377812 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.378206 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] PATH_INFO: `/v3/projects/65738eb104ae4a0daa69c7747b6ec843/users/8fb913c671294964b34cddbdba90205b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.386746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1361/2725] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:53 2022] PUT /identity/v3/projects/eab9a53e39f04138a252fe81206f175f/users/41713297e55d4181a22957424571aae5/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:53.394420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65738eb104ae4a0daa69c7747b6ec843, user_id=8fb913c671294964b34cddbdba90205b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.396879 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.397081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.397208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.397406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.412385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1365/2726] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:53 2022] PUT /identity/v3/projects/65738eb104ae4a0daa69c7747b6ec843/users/8fb913c671294964b34cddbdba90205b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:53.416815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.427946 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] MFA Rules not processed for user `41713297e55d4181a22957424571aae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:53.429259 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:53.482885 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a90b19-1071-4915-bf72-b1103a7a95a0 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.487640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.488245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.488524 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.488797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.489433 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.491039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.496430 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:53.502115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1366/2727] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:53.502282 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1362/2728] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:53.506045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.514702 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.516120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:53.517252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aad3e-4250-4132-8e97-8294bc1714a5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.521891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.522542 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.522819 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.523095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] PATH_INFO: `/v3/projects/65738eb104ae4a0daa69c7747b6ec843/users/8fb913c671294964b34cddbdba90205b/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.525681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65738eb104ae4a0daa69c7747b6ec843, user_id=8fb913c671294964b34cddbdba90205b, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.528392 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0253f-a032-41a9-b417-13ca05414085 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.538869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1367/2729] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:53 2022] PUT /identity/v3/projects/65738eb104ae4a0daa69c7747b6ec843/users/8fb913c671294964b34cddbdba90205b/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:53.549045 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.549330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.549596 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.573119 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1bb47-9a33-499f-bdfd-b9ea84b7a966 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.576930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] MFA Rules not processed for user `8fb913c671294964b34cddbdba90205b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:53.578151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:53.594293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:53.627792 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.628337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.628614 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.628908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.652982 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1368/2730] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:53.664618 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.666028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:53.678087 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb2a0-8de3-416c-bd20-4cbd4e67d49c None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.681802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.682506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.682786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.683050 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.689009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.690431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.692047 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.693454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.700089 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1363/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:53.703993 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1369/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:53.743059 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:53.752575 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc39ce-d2ee-4821-92c7-1083580ec6c5 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:53.756414 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:53.757135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:53.757418 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:53.757741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:53.816470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:53.817900 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc4feb-4d61-4594-a21e-ff87d02b7d2e service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:53.828151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1364/2733] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:54.258122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:54.321668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f38e-9d26-4d69-a583-a1374d6383cc service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:54.326498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:54.327122 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:54.327399 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:54.327706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] PATH_INFO: `/v3/users/171ba5bf24d04c63b6734e81b36f274a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:54.328807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171ba5bf24d04c63b6734e81b36f274a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:54.330716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:54.376570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171ba5bf24d04c63b6734e81b36f274a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.386704 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:54.389169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171ba5bf24d04c63b6734e81b36f274a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.396780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171ba5bf24d04c63b6734e81b36f274a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.397670 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171ba5bf24d04c63b6734e81b36f274a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.405557 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171ba5bf24d04c63b6734e81b36f274a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.411362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1370/2734] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:54 2022] DELETE /identity/v3/users/171ba5bf24d04c63b6734e81b36f274a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:54.416587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:54.416891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:54.417162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:54.435434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:54.436639 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:54.494358 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1365/2735] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:54.504218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:54.506180 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:54.566304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f167611-6a67-4fd5-a8b3-384378ee52b8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:54.570032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:54.571135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:54.571414 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:54.571772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:54.581083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:54.582515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:54.592638 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1371/2736] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:54.855763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:54.857236 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:54.871835 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47496047-ef60-4f54-83ab-35b5a252d61a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:54.876708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:54.877337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:54.877612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:54.877880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] PATH_INFO: `/v3/projects/c21037a9558d4e97ac520189772a1e21` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:54.879121 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21037a9558d4e97ac520189772a1e21)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:54.881060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:54.888279 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:54.928214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21037a9558d4e97ac520189772a1e21', 'request_id': 'req-b66bfbf2-f658-4e83-8c58-ceb8623564cf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.934332 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21037a9558d4e97ac520189772a1e21', 'request_id': 'req-b66bfbf2-f658-4e83-8c58-ceb8623564cf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.948824 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21037a9558d4e97ac520189772a1e21', 'request_id': 'req-b66bfbf2-f658-4e83-8c58-ceb8623564cf'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.965687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] The token cache is being invalidate because project c21037a9558d4e97ac520189772a1e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:54.965976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.966610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:54.968162 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1366/2737] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:54 2022] DELETE /identity/v3/projects/c21037a9558d4e97ac520189772a1e21 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:54.972192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:54.981828 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52960aba-c52d-4a81-becb-3770318ff9b2 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.036402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.037020 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.037302 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.037574 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] PATH_INFO: `/v3/users/8fb913c671294964b34cddbdba90205b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.038683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb913c671294964b34cddbdba90205b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.040663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.093165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb913c671294964b34cddbdba90205b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.104887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb913c671294964b34cddbdba90205b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.112270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb913c671294964b34cddbdba90205b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.113175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb913c671294964b34cddbdba90205b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.120708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-0feb8750-1e69-40d3-af5c-05e85336c8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb913c671294964b34cddbdba90205b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.122758 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:55.131260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1372/2738] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:54 2022] DELETE /identity/v3/users/8fb913c671294964b34cddbdba90205b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:55.419863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.422881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:55.454688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bfbf2-f658-4e83-8c58-ceb8623564cf admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.518248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.519040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.519407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.519688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] PATH_INFO: `/v3/projects/65738eb104ae4a0daa69c7747b6ec843` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.521008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65738eb104ae4a0daa69c7747b6ec843)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.522984 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.572080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65738eb104ae4a0daa69c7747b6ec843', 'request_id': 'req-769ef590-72b3-4d7b-8d22-37fcd1d31f81'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.578149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65738eb104ae4a0daa69c7747b6ec843', 'request_id': 'req-769ef590-72b3-4d7b-8d22-37fcd1d31f81'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.586240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65738eb104ae4a0daa69c7747b6ec843', 'request_id': 'req-769ef590-72b3-4d7b-8d22-37fcd1d31f81'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.600863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] The token cache is being invalidate because project 65738eb104ae4a0daa69c7747b6ec843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:55.601152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.602407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-769ef590-72b3-4d7b-8d22-37fcd1d31f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:55.604595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1367/2739] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:55 2022] DELETE /identity/v3/projects/65738eb104ae4a0daa69c7747b6ec843 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:55.609359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.609818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.609919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.631426 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:55.632700 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:55.693592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1373/2740] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:55.702795 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.703101 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.703393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.723063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:55.724314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:55.733108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1368/2741] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:55.737326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.747199 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90453b4-1212-4191-90e0-5b5162f4fcaa None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.751807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.752400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.752677 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.752946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.753586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:55.754007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.755642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.767166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1374/2742] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:48:55.771774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.781807 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4fc8-c999-4271-9706-06fbfe9376da None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.786364 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.786943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.787213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.787478 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.788113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.790637 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.806828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:55.823778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1369/2743] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:55 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:55.824771 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.834768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dbb78-64d1-4554-a652-a8547bf948fd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.893196 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.893682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.893957 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.894249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.894869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.896809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.918644 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1375/2744] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:55 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:55.922798 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.933093 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cfb8-6a63-4c12-b331-72688d5f2e88 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.937695 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.938287 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.938566 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.938841 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.939477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.941110 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.951133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1370/2745] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:55.955120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.965587 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a792-98c3-4d56-9271-e260aee001ec admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:55.970166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:55.970752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:55.971030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:55.971299 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:55.971965 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:55.973543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c0080-aab7-421e-9fc6-aa4f3aa945fb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:55.984591 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1376/2746] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:55.988565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:55.998367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587045a-a313-432e-a42f-ac0776bf497d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:56.002935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:56.003608 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.003891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.004167 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] PATH_INFO: `/v3/projects/79af4e4c37954eccba4385577ce68dcd/users/3e33d51101b14589a7e440be6fdbb20d/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.018223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=79af4e4c37954eccba4385577ce68dcd, user_id=3e33d51101b14589a7e440be6fdbb20d, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:56.020893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:56.033880 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1371/2747] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:55 2022] PUT /identity/v3/projects/79af4e4c37954eccba4385577ce68dcd/users/3e33d51101b14589a7e440be6fdbb20d/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:56.039481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.039803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.040069 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.058324 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:56.059523 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.117192 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1377/2748] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:56.126774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:56.128460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.183763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defc506-7494-40a9-a438-a805d42762fa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:56.187406 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:56.188033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.188311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.188582 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.198086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:56.199484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12398225-144f-4899-8a9e-53daadd1a6c2 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:56.208729 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1372/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:56.744205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:56.745640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.757525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a1fe-e34f-477c-ac07-97d291078dc8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:56.763038 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:56.763690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.763966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.764233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] PATH_INFO: `/v3/users/03fe6eb615ac4c44b5282c00dce8215d` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.765364 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fe6eb615ac4c44b5282c00dce8215d)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:56.767409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:56.772539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:56.828460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fe6eb615ac4c44b5282c00dce8215d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:56.834106 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.834563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.835716 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.843030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fe6eb615ac4c44b5282c00dce8215d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:56.853685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fe6eb615ac4c44b5282c00dce8215d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:56.854421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fe6eb615ac4c44b5282c00dce8215d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:56.862260 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6daa6223-879c-4baa-a029-0f73df387b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fe6eb615ac4c44b5282c00dce8215d'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:56.869025 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1378/2750] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:56 2022] DELETE /identity/v3/users/03fe6eb615ac4c44b5282c00dce8215d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:56.873606 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:56.873990 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:56.874376 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:56.876140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] MFA Rules not processed for user `3e33d51101b14589a7e440be6fdbb20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:56.877497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.895174 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:56.896504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.954218 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1373/2751] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:56.961773 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1379/2752] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:56.965144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:56.966972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:56.971987 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:56.973460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:57.031914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b1c09-eee1-4fd4-aac2-1f941b708a25 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:57.036293 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:57.036914 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:57.037195 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:57.037468 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:57.040713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa07ab6-d686-4c10-9167-ba573dfb4efb None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:57.044368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:57.044632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:57.044967 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:57.045250 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:57.045672 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:57.047380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:57.049003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:57.055592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:57.057049 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:57.060204 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1374/2753] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:57.068809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1380/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 08:48:57.366963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:57.368518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:57.384030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d3af-99b3-400f-96b9-d396371d7cf7 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:57.389408 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:57.390124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:57.390470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:57.390826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] PATH_INFO: `/v3/projects/9d389a7bc00d4acc841ded544a1a520a` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:57.392062 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d389a7bc00d4acc841ded544a1a520a)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:57.394041 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:57.446538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d389a7bc00d4acc841ded544a1a520a', 'request_id': 'req-52f7731b-b95a-43c7-a7b5-b781066e361f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.452424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d389a7bc00d4acc841ded544a1a520a', 'request_id': 'req-52f7731b-b95a-43c7-a7b5-b781066e361f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.459683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d389a7bc00d4acc841ded544a1a520a', 'request_id': 'req-52f7731b-b95a-43c7-a7b5-b781066e361f'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.471215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] The token cache is being invalidate because project 9d389a7bc00d4acc841ded544a1a520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:57.471502 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.472151 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.473612 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1375/2755] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:57 2022] DELETE /identity/v3/projects/9d389a7bc00d4acc841ded544a1a520a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:57.478175 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:57.488233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d4974-2aa6-4c64-8a2f-7c8979831b57 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:57.505963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:57.546270 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:57.546824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:57.547095 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:57.547362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] PATH_INFO: `/v3/users/9e6d6bc9845940bb8530ee32b1ab1476` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:57.548498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6d6bc9845940bb8530ee32b1ab1476)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:57.550389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:57.595365 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6d6bc9845940bb8530ee32b1ab1476'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.608417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6d6bc9845940bb8530ee32b1ab1476'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.615997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6d6bc9845940bb8530ee32b1ab1476'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.616786 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6d6bc9845940bb8530ee32b1ab1476'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.623779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6d6bc9845940bb8530ee32b1ab1476'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:57.629537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1381/2756] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:57 2022] DELETE /identity/v3/users/9e6d6bc9845940bb8530ee32b1ab1476 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:57.896083 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:57.897607 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:57.911372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7731b-b95a-43c7-a7b5-b781066e361f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:57.968423 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:57.969050 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:57.969321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:57.969592 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] PATH_INFO: `/v3/projects/41f2a8bb8bbd498ba9ec13e286f397b7` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:57.970700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f2a8bb8bbd498ba9ec13e286f397b7)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:57.972635 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.018127 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f2a8bb8bbd498ba9ec13e286f397b7', 'request_id': 'req-0fa87b23-eda7-4ff7-ae0e-87778fd20955'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.023601 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f2a8bb8bbd498ba9ec13e286f397b7', 'request_id': 'req-0fa87b23-eda7-4ff7-ae0e-87778fd20955'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.030793 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f2a8bb8bbd498ba9ec13e286f397b7', 'request_id': 'req-0fa87b23-eda7-4ff7-ae0e-87778fd20955'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.042390 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] The token cache is being invalidate because project 41f2a8bb8bbd498ba9ec13e286f397b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:58.042677 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.043316 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0fa87b23-eda7-4ff7-ae0e-87778fd20955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.044802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1376/2757] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:57 2022] DELETE /identity/v3/projects/41f2a8bb8bbd498ba9ec13e286f397b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:58.048716 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.050146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.063329 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0659c-0376-4db2-bca3-4d5a3cc5f367 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.119465 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.120055 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.120328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.120598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] PATH_INFO: `/v3/users/41713297e55d4181a22957424571aae5` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.121707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41713297e55d4181a22957424571aae5)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.123649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.167385 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:58.169746 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41713297e55d4181a22957424571aae5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.184706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41713297e55d4181a22957424571aae5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.191663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41713297e55d4181a22957424571aae5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.192271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41713297e55d4181a22957424571aae5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.199902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41713297e55d4181a22957424571aae5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.205689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1382/2758] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:48:58 2022] DELETE /identity/v3/users/41713297e55d4181a22957424571aae5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:58.428459 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c71-f460-4b31-8e07-278756fff007 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.428742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c71-f460-4b31-8e07-278756fff007 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.429019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e23c71-f460-4b31-8e07-278756fff007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.449476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-00e23c71-f460-4b31-8e07-278756fff007 None None] MFA Rules not processed for user `3e33d51101b14589a7e440be6fdbb20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:58.450700 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-00e23c71-f460-4b31-8e07-278756fff007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.454687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:58.484686 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.486274 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.521224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1377/2759] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:58.565419 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705987-a2a6-4ebd-9950-fe588fadc46e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.570028 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.570680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.570956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.571227 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] PATH_INFO: `/v3/projects/eab9a53e39f04138a252fe81206f175f` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.572525 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab9a53e39f04138a252fe81206f175f)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.574682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.625983 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab9a53e39f04138a252fe81206f175f', 'request_id': 'req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.632008 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab9a53e39f04138a252fe81206f175f', 'request_id': 'req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.639439 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab9a53e39f04138a252fe81206f175f', 'request_id': 'req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.651189 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] The token cache is being invalidate because project eab9a53e39f04138a252fe81206f175f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:48:58.651579 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.652234 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5fe5f4fb-ec00-4995-ab10-fbf3859fcfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:48:58.653724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1383/2760] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:48:58 2022] DELETE /identity/v3/projects/eab9a53e39f04138a252fe81206f175f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:58.659767 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.660144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.660420 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.680372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:58.681565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.741086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1378/2761] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:48:58.750747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.751027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.751297 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.763701 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.765219 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.770873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:58.772092 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.780664 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1384/2762] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:58.784701 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.794345 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e1862-a89a-4ef6-a347-2a91c1f630cf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.799011 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.799635 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.799917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.800185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.800848 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:48:58.801150 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.802891 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.818040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1385/2763] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 08:48:58.818963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.822457 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bc1e5-5440-48a9-b91a-5dcdadb9868f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.826973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.827595 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.827876 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.828146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.828710 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cb03f-cbe0-4630-874f-3ad511617393 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.829859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:58.833214 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.833785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.834062 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.834332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.834937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.837359 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.840092 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.841498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.849602 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1379/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:58.869695 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1386/2765] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:58 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:58.873863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.885311 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2418ab-7f67-4f11-8491-4efbfc010d24 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.935120 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:58.941573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.942498 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.943054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.943359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.944078 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.946830 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.969647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1380/2766] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:58 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:58.973808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:58.985181 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded29ec-6a5c-4a5a-bc1f-c7b1d3b81b1e admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:58.989747 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:58.990338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:58.990612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:58.990878 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:58.991506 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:58.993151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:58.995663 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:59.005321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1387/2767] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:59.009706 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.021066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03fab1-30e5-47ff-a1c5-6033cf57ffdc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.026769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.027402 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.027863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.028135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.028772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.030563 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289970b2-e577-4515-a035-981f053d6d7d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.041018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1381/2768] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:59.044986 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.055157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557d396-ef85-43dc-96a1-44cf3e2d8256 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.061060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.061649 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.061960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.062187 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] PATH_INFO: `/v3/projects/6943fa0440254bd8a1470df47c4082b0/users/e5d970c331cf495892e946953cefd780/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.077831 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6943fa0440254bd8a1470df47c4082b0, user_id=e5d970c331cf495892e946953cefd780, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.080612 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.094230 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1388/2769] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:59 2022] PUT /identity/v3/projects/6943fa0440254bd8a1470df47c4082b0/users/e5d970c331cf495892e946953cefd780/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:59.105277 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.105560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.105832 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.134515 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] MFA Rules not processed for user `e5d970c331cf495892e946953cefd780`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:59.135741 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:59.178558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.180515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:59.208774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1382/2770] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:59.213467 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.266743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef2f4f-ea59-4925-9b90-7b318060f5d8 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.271961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.272586 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.272858 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.273131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.275491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:59.285220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5778a-b1fe-420d-a700-33b03729336a None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.287418 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.289117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.289238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.289746 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.290024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.290295 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.291024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.292926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.299218 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1389/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:48:59.319568 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1383/2772] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:48:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:48:59.324390 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.334661 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3601e2-3b0a-4f79-8098-bd3ede6d98bc service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.394864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.395477 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.395780 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.396077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.396687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.399238 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.427903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1390/2773] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:48:59 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:48:59.428708 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.439425 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcaa37-7d47-4964-b43c-718f3d2f70d5 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.443995 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.444584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.444859 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.445175 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.445806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.447362 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.461718 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1384/2774] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:48:59.462994 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.473814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2233f95-e7f7-40bd-ae20-e02978bfb544 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.479955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.480607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.480886 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.481157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] PATH_INFO: `/v3/projects/60185713e2084dd29fad611af03f11b4/users/c18e3cc540014955adcfd1f1859eb8f0/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.496617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60185713e2084dd29fad611af03f11b4, user_id=c18e3cc540014955adcfd1f1859eb8f0, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.499428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.515653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1391/2775] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:59 2022] PUT /identity/v3/projects/60185713e2084dd29fad611af03f11b4/users/c18e3cc540014955adcfd1f1859eb8f0/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:48:59.519627 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.535571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f18b-6e00-4c83-8b0e-d59dddd61e85 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.578597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:59.600524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.601397 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.602222 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.602474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.603124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.604745 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275133b3-5b5d-4093-b7c1-a37a174b7a5c admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.615565 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1385/2776] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:48:59.620239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.630914 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0461a-b5fa-4df4-a756-3f4f8a69feb5 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.636580 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.637298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.637582 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.637856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] PATH_INFO: `/v3/projects/60185713e2084dd29fad611af03f11b4/users/c18e3cc540014955adcfd1f1859eb8f0/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.639995 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60185713e2084dd29fad611af03f11b4, user_id=c18e3cc540014955adcfd1f1859eb8f0, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.642572 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.653209 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1392/2777] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:48:59 2022] PUT /identity/v3/projects/60185713e2084dd29fad611af03f11b4/users/c18e3cc540014955adcfd1f1859eb8f0/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:48:59.663344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.663684 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.664013 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.694730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] MFA Rules not processed for user `c18e3cc540014955adcfd1f1859eb8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:48:59.696594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:59.764838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1386/2778] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:48:59.775673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:48:59.777577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:48:59.801804 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:59.843079 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203c89-4b8a-4ef1-b199-5a746f6305c3 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:48:59.846681 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:48:59.847275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:48:59.847570 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:48:59.847851 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:48:59.906172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:48:59.907631 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:48:59.917620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1393/2779] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:48:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:04.171066 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:04.172589 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:04.184487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f935-284c-4af7-864e-bf73de8a28c6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:04.188123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:04.188724 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:04.188996 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:04.189260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:04.198504 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:04.199938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:04.209032 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1387/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:07.390405 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:07.392019 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:07.469667 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b654fd-0985-4d08-bafe-7ddc61cc63d9 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:07.475641 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:07.476268 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:07.476558 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:07.476809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:07.478531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:07.490873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:07.492546 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655457-fa22-4173-a363-3a14836a3e16 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:07.503303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1394/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:09.064177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:09.123890 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ee35-bad5-4938-a820-f7a1dda49cb2 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:09.128437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:09.129054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:09.129328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:09.129597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] PATH_INFO: `/v3/users/e5d970c331cf495892e946953cefd780` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:09.130704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d970c331cf495892e946953cefd780)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:09.133220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:09.182319 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d970c331cf495892e946953cefd780'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.184284 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:09.197483 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d970c331cf495892e946953cefd780'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.198401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d970c331cf495892e946953cefd780'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.205416 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d970c331cf495892e946953cefd780'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.206058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d970c331cf495892e946953cefd780'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.217896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1388/2782] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:09 2022] DELETE /identity/v3/users/e5d970c331cf495892e946953cefd780 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:09.222400 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:09.222876 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:09.222985 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:09.241637 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:09.243632 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:09.290731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:09.302807 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1395/2783] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:09.312972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:09.314357 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:09.371003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c247c-1ec2-4e4d-b7d7-bf23fceb53e0 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:09.374688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:09.375233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:09.375509 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:09.375810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:09.385380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:09.386786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:09.396647 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1389/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:09.660657 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:09.662239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:09.676862 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732102fd-0ee3-444e-8daf-e74029391b98 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:09.682529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:09.683301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:09.683611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:09.683887 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] PATH_INFO: `/v3/projects/6943fa0440254bd8a1470df47c4082b0` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:09.685097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6943fa0440254bd8a1470df47c4082b0)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:09.686930 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:09.734947 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6943fa0440254bd8a1470df47c4082b0', 'request_id': 'req-6d7064b1-0e07-4ef3-bbf2-89d14a037211'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.740443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6943fa0440254bd8a1470df47c4082b0', 'request_id': 'req-6d7064b1-0e07-4ef3-bbf2-89d14a037211'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.748213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6943fa0440254bd8a1470df47c4082b0', 'request_id': 'req-6d7064b1-0e07-4ef3-bbf2-89d14a037211'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.759628 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] The token cache is being invalidate because project 6943fa0440254bd8a1470df47c4082b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:09.759915 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.760543 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.761999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1396/2785] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:09 2022] DELETE /identity/v3/projects/6943fa0440254bd8a1470df47c4082b0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:09.766558 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:09.776688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa143ad-5707-48f7-a05d-c6ddacfc2619 service neutron] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:09.834751 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:09.835370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:09.835719 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:09.835991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] PATH_INFO: `/v3/users/c18e3cc540014955adcfd1f1859eb8f0` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:09.837086 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18e3cc540014955adcfd1f1859eb8f0)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:09.838969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:09.884166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18e3cc540014955adcfd1f1859eb8f0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.897806 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18e3cc540014955adcfd1f1859eb8f0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.898486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18e3cc540014955adcfd1f1859eb8f0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.905440 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18e3cc540014955adcfd1f1859eb8f0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.906260 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9a9e615a-a95b-4da9-9713-a854d9bf8735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18e3cc540014955adcfd1f1859eb8f0'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:09.907557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:09.921778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1390/2786] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:09 2022] DELETE /identity/v3/users/c18e3cc540014955adcfd1f1859eb8f0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:10.276242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.277673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:10.300999 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7064b1-0e07-4ef3-bbf2-89d14a037211 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.371935 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.372562 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.372849 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.373115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] PATH_INFO: `/v3/projects/60185713e2084dd29fad611af03f11b4` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.374245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60185713e2084dd29fad611af03f11b4)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.376183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.422900 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60185713e2084dd29fad611af03f11b4', 'request_id': 'req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:10.428301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60185713e2084dd29fad611af03f11b4', 'request_id': 'req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:10.435350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60185713e2084dd29fad611af03f11b4', 'request_id': 'req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:10.447117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] The token cache is being invalidate because project 60185713e2084dd29fad611af03f11b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:10.447404 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:10.448438 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-5d1bd15b-4956-4f9f-a071-88bafb70bb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:10.449903 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1397/2787] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:10 2022] DELETE /identity/v3/projects/60185713e2084dd29fad611af03f11b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:10.456224 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.456704 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.456815 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.476802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:10.478024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:10.540834 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1391/2788] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:10.548955 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.549239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.549515 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.569585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:10.571627 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:10.580164 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1398/2789] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:10.584550 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.595444 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ebcb6-522b-4b33-bcc1-6fc47388123f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.600237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.600836 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.601144 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.601520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.602193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:49:10.602500 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.604166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.617254 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1392/2790] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:49:10.620735 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.625278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:10.631777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc957-b18e-4a7c-9310-1e97dd446ce6 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.638796 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.639472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.639778 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.640048 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.640668 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.642589 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.675799 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1399/2791] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:10 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:49:10.677464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.688750 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086c92-cdbb-4ad7-9d4c-7760b50b7354 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.749771 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.752866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.752866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.752866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.752866 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.753470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.779019 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1393/2792] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:10 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:49:10.780363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.791317 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cb328-c3eb-441e-a8d1-5697724d5d4a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.796120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.796730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.797005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.797281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.797923 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.799505 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.810322 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1400/2793] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:10.814447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.825261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a98fef-13fc-4fcd-adbf-4fe97cada857 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.829939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.830531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.830809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.831080 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.831777 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.833363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c92bf6-795f-4ccd-a578-d36ac6e7fe4e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.846906 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1394/2794] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 08:49:10.848148 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:10.858116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b4e7-d1fb-4212-8d64-251832f830cc admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:10.862651 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:10.863401 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.863705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.863978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] PATH_INFO: `/v3/projects/2749d335845e4d3d9a80cb9f72b704b8/users/cfd0f7087993461f90c171ecbd056515/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.878504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2749d335845e4d3d9a80cb9f72b704b8, user_id=cfd0f7087993461f90c171ecbd056515, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:10.881165 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:10.894383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1401/2795] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:10 2022] PUT /identity/v3/projects/2749d335845e4d3d9a80cb9f72b704b8/users/cfd0f7087993461f90c171ecbd056515/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:10.905615 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:10.905897 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:10.906166 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:10.933929 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] MFA Rules not processed for user `cfd0f7087993461f90c171ecbd056515`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:10.935058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:10.978458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:11.000211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1395/2796] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:11.006712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.067938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7972dcd-0b33-433b-9f25-a02db4aef7f0 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.073420 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.074015 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.074291 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.074560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.075182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.077109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.106502 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1402/2797] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:11.107688 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.119147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745669e3-3961-46d0-b6d1-71d3d83bdba6 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.175196 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.175819 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.176091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.176359 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.176961 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.178845 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.199454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1396/2798] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:11.203410 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.213620 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eab76-1be8-43b4-aca6-9e715a0b7aae admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.218157 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.218743 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.219017 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.219285 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.219950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.221521 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.232481 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1403/2799] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:11.236176 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.248005 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b7e8-1c4c-4df4-b417-44ac34348929 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.252519 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.253103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.253393 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.253642 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.254305 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.255923 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81c994-df7e-43f5-bcb5-2089475b2cc8 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.265632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1397/2800] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:11.269607 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.279660 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae45a6d-6f5b-4a6a-878f-09e0692d1783 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.284331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.284960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.285232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.285498 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] PATH_INFO: `/v3/projects/d7e1b9d83c274dee8145daeb96948ef6/users/98ccc32617db4993a0ede6883a271a0b/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.300463 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1b9d83c274dee8145daeb96948ef6, user_id=98ccc32617db4993a0ede6883a271a0b, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.303077 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.316511 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1404/2801] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:11 2022] PUT /identity/v3/projects/d7e1b9d83c274dee8145daeb96948ef6/users/98ccc32617db4993a0ede6883a271a0b/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:11.380721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.380980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.381246 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.408935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] MFA Rules not processed for user `98ccc32617db4993a0ede6883a271a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:11.410135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:11.473238 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1398/2802] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:11.478242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.534536 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:11.541289 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a2ac3-9576-47b1-8b79-748a2382188c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.546341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.546938 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.547213 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.547479 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.548156 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.550034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.576942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1405/2803] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:11.580990 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.592133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b714ace-4077-4ea9-9d89-8d1614c0c6dd None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.639597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:11.650172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.650774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.651058 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.651331 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.651993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.653892 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.674862 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1399/2804] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:11.678814 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.688977 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1c56-0c80-4397-9f3d-29b3412f0644 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.693772 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.694373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.695240 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.695566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.696217 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.698177 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.708774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1406/2805] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:11.713410 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.723427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8203139-fb1e-40c8-85c7-3d8cec482b66 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.728868 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.729524 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.729804 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.730081 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] PATH_INFO: `/v3/projects/ea316c2b04494749a49eebbe506258d6/users/5bd60fe10c0c4eb79f874b5a4393548a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.744561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea316c2b04494749a49eebbe506258d6, user_id=5bd60fe10c0c4eb79f874b5a4393548a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.747205 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.760073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1400/2806] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:11 2022] PUT /identity/v3/projects/ea316c2b04494749a49eebbe506258d6/users/5bd60fe10c0c4eb79f874b5a4393548a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:11.764000 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.774583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9feb-2179-4877-8cbe-6b5d7807216c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.831583 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.832185 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.832466 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.832737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.833368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.834949 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0eb3b-ede1-432d-9be7-dae8dd06b27c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.845170 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1407/2807] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:11.849312 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:11.859769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a5f7-2866-4d39-9399-fa0415352675 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:11.864407 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:11.865047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.865328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.865632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] PATH_INFO: `/v3/projects/ea316c2b04494749a49eebbe506258d6/users/5bd60fe10c0c4eb79f874b5a4393548a/roles/4a7c9bba983f483f9f1d305a364e0521` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.867855 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea316c2b04494749a49eebbe506258d6, user_id=5bd60fe10c0c4eb79f874b5a4393548a, role_id=4a7c9bba983f483f9f1d305a364e0521)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:11.870484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:11.881555 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1401/2808] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:11 2022] PUT /identity/v3/projects/ea316c2b04494749a49eebbe506258d6/users/5bd60fe10c0c4eb79f874b5a4393548a/roles/4a7c9bba983f483f9f1d305a364e0521 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:11.893124 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:11.893415 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:11.893679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:11.921919 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] MFA Rules not processed for user `5bd60fe10c0c4eb79f874b5a4393548a`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:11.923131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:11.998357 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1408/2809] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:12.010564 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:12.012024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:12.068944 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6c20-6de3-472d-a77d-de9e9b6c311d admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:12.072664 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:12.073523 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:12.073797 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:12.074063 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:12.129552 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:12.130974 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:12.139882 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1402/2810] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:12.891611 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:12.893071 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:12.953313 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:12.981961 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913ac2-e7b5-4340-b312-4345974da04f None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:12.988374 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:12.989088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:12.989504 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:12.989865 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:12.991791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:13.005109 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:13.006724 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048db79-b7e5-4e8c-a145-c295f258b3ac service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:13.017888 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1409/2811] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:13.644886 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:13.646317 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:13.657383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2092-bd00-45b1-b484-8ab9aea40bb7 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:13.660887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:13.661474 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:13.661747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:13.662014 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:13.717235 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:13.718574 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:13.722036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:13.729666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1403/2812] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:14.205742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:14.206243 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:14.206363 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:14.225159 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] MFA Rules not processed for user `3e33d51101b14589a7e440be6fdbb20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:14.226950 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:14.246801 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:14.255925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd8fd8-170b-4738-a7f1-f1d59c210843 service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:14.259648 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:14.260315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:14.260619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:14.261047 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:14.270064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:14.271516 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:14.281208 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1404/2813] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:14.284315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1410/2814] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:14.518237 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:14.519749 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:14.580586 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198f44-a0d4-4fae-965f-7b4822397a9e service cinder] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:14.585076 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:14.586433 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:14.586752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:14.587021 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:14.588785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:14.598560 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:14.599999 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a7ff-f7fc-4979-bc34-66083e7c494a service neutron] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:14.610388 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1405/2815] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:18.153722 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:18.215966 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fe378-9976-4506-bd4b-888092a94cc8 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:18.220577 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:18.221202 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:18.221482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:18.221755 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] PATH_INFO: `/v3/users/cfd0f7087993461f90c171ecbd056515` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:18.222882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd0f7087993461f90c171ecbd056515)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:18.224827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:18.271013 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd0f7087993461f90c171ecbd056515'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.282692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd0f7087993461f90c171ecbd056515'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.290984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd0f7087993461f90c171ecbd056515'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.291690 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd0f7087993461f90c171ecbd056515'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.299326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd0f7087993461f90c171ecbd056515'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.301808 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:18.308978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1411/2816] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:18 2022] DELETE /identity/v3/users/cfd0f7087993461f90c171ecbd056515 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:18.314538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:18.315033 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:18.315531 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:18.340265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:18.341491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:18.403234 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1406/2817] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:49:18.413097 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:18.414585 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:18.476089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1e17-7110-4ad5-a6f8-e0a1ac97540a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:18.479984 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:18.480714 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:18.480998 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:18.481298 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:18.490569 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:18.492042 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:18.502864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1412/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:18.779268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:18.780812 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:18.795215 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedd265-ae86-4c66-8512-7cba1be8a78b None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:18.801460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:18.802100 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:18.802378 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:18.802649 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] PATH_INFO: `/v3/projects/2749d335845e4d3d9a80cb9f72b704b8` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:18.803817 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2749d335845e4d3d9a80cb9f72b704b8)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:18.806377 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:18.855671 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2749d335845e4d3d9a80cb9f72b704b8', 'request_id': 'req-9633554d-f593-4ebb-9fba-cf4c09749ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.861117 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2749d335845e4d3d9a80cb9f72b704b8', 'request_id': 'req-9633554d-f593-4ebb-9fba-cf4c09749ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.869213 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2749d335845e4d3d9a80cb9f72b704b8', 'request_id': 'req-9633554d-f593-4ebb-9fba-cf4c09749ef1'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.880431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] The token cache is being invalidate because project 2749d335845e4d3d9a80cb9f72b704b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:18.880714 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.881403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:18.882954 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1407/2819] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:18 2022] DELETE /identity/v3/projects/2749d335845e4d3d9a80cb9f72b704b8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:18.887029 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:18.896674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c276-4381-4016-b76c-44cc6e76f04b service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:18.955032 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:18.955845 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:18.956126 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:18.956397 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] PATH_INFO: `/v3/users/98ccc32617db4993a0ede6883a271a0b` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:18.957617 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ccc32617db4993a0ede6883a271a0b)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:18.959561 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:19.006030 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ccc32617db4993a0ede6883a271a0b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.018296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ccc32617db4993a0ede6883a271a0b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.025791 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ccc32617db4993a0ede6883a271a0b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.026571 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ccc32617db4993a0ede6883a271a0b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.036232 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ccc32617db4993a0ede6883a271a0b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.043060 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1413/2820] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:18 2022] DELETE /identity/v3/users/98ccc32617db4993a0ede6883a271a0b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:19.318307 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:19.319838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:19.332895 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633554d-f593-4ebb-9fba-cf4c09749ef1 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:19.340902 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:19.394211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:19.394839 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:19.395112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:19.395380 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] PATH_INFO: `/v3/projects/d7e1b9d83c274dee8145daeb96948ef6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:19.396545 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e1b9d83c274dee8145daeb96948ef6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:19.398419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:19.443464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e1b9d83c274dee8145daeb96948ef6', 'request_id': 'req-61d4ec81-2807-407d-b3bd-1047b09bb494'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.449164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e1b9d83c274dee8145daeb96948ef6', 'request_id': 'req-61d4ec81-2807-407d-b3bd-1047b09bb494'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.456227 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e1b9d83c274dee8145daeb96948ef6', 'request_id': 'req-61d4ec81-2807-407d-b3bd-1047b09bb494'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.466980 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] The token cache is being invalidate because project d7e1b9d83c274dee8145daeb96948ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:19.467265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.467913 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.469366 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1408/2821] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:19 2022] DELETE /identity/v3/projects/d7e1b9d83c274dee8145daeb96948ef6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:19.473361 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:19.474785 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:19.488117 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa97b3-aca5-4926-9bcf-6a2ba2d1db63 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:19.506336 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:19.546449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:19.547067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:19.547339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:19.547659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] PATH_INFO: `/v3/users/5bd60fe10c0c4eb79f874b5a4393548a` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:19.548768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd60fe10c0c4eb79f874b5a4393548a)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:19.550666 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:19.611476 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd60fe10c0c4eb79f874b5a4393548a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.624314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd60fe10c0c4eb79f874b5a4393548a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.632245 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd60fe10c0c4eb79f874b5a4393548a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.632937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd60fe10c0c4eb79f874b5a4393548a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.641599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-825e7515-4a80-4203-8b75-962019ba1820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd60fe10c0c4eb79f874b5a4393548a'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:19.647592 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1414/2822] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:19 2022] DELETE /identity/v3/users/5bd60fe10c0c4eb79f874b5a4393548a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:19.913430 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:19.915491 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:19.933161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4ec81-2807-407d-b3bd-1047b09bb494 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:19.991133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:19.991791 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:19.992072 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:19.992341 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] PATH_INFO: `/v3/projects/ea316c2b04494749a49eebbe506258d6` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:19.993991 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea316c2b04494749a49eebbe506258d6)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:19.995935 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.038077 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:20.042860 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea316c2b04494749a49eebbe506258d6', 'request_id': 'req-d3fc5110-062a-4b8a-8308-9caf03ea225b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:20.049561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea316c2b04494749a49eebbe506258d6', 'request_id': 'req-d3fc5110-062a-4b8a-8308-9caf03ea225b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:20.057573 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea316c2b04494749a49eebbe506258d6', 'request_id': 'req-d3fc5110-062a-4b8a-8308-9caf03ea225b'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:20.069055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] The token cache is being invalidate because project ea316c2b04494749a49eebbe506258d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:20.069337 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:20.069972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-d3fc5110-062a-4b8a-8308-9caf03ea225b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:20.071428 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1409/2823] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:19 2022] DELETE /identity/v3/projects/ea316c2b04494749a49eebbe506258d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:20.076534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.076815 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.077113 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.096425 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:20.097625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:20.155462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1415/2824] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:20.163160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.163403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.163723 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.184004 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:20.185198 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:20.193268 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1410/2825] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:20.197318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.207021 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ccec5-9962-44f8-86bf-d8c34054f046 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.211554 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.212201 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.212482 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.212753 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.213389 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:49:20.213687 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.215349 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.227394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1416/2826] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:49:20.231437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.241211 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d21d7-48d1-4c2f-919d-f762cd72acc8 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.247313 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.248103 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.248381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.248654 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.249276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.251154 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.277152 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1411/2827] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:20 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:20.281386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.291892 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea668d3-2db6-40f8-b298-f5c12cbe3e29 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.317647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:20.350742 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.351334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.351642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.352423 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.353040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.354946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.375041 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1417/2828] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:20 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:20.379135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.389347 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33d855-a826-4698-8edf-715ea22031da admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.393896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.394486 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.394763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.395030 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.395699 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.397276 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.406932 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1412/2829] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:20.410749 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.421281 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283077-660b-433f-9f25-c1efb386be52 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.425835 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.426449 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.426727 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.427018 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.427675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.429254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2859-cb53-49ed-b615-0104f29512e4 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.439654 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1418/2830] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:20.445114 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.455379 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb32f87-5fa9-42a9-a7dc-b326d3af8ebd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.460048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.460687 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.460970 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.461240 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] PATH_INFO: `/v3/projects/b4218fb2238c43388ec1793c19c6e4ac/users/cb79aa1c9727403bb103695a7d195c36/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.475875 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4218fb2238c43388ec1793c19c6e4ac, user_id=cb79aa1c9727403bb103695a7d195c36, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.479135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.491854 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1413/2831] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:20 2022] PUT /identity/v3/projects/b4218fb2238c43388ec1793c19c6e4ac/users/cb79aa1c9727403bb103695a7d195c36/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:20.501946 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d590c4-9f49-4c0a-864d-99a62056278d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.502429 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d590c4-9f49-4c0a-864d-99a62056278d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.502533 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d590c4-9f49-4c0a-864d-99a62056278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.530249 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-b6d590c4-9f49-4c0a-864d-99a62056278d None None] MFA Rules not processed for user `cb79aa1c9727403bb103695a7d195c36`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:20.531457 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-b6d590c4-9f49-4c0a-864d-99a62056278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:20.594896 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1419/2832] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:20.607214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:20.608887 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:20.685439 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769bda-fbf8-46c8-a87b-9a63edc39dfa admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:20.689036 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c633e39c46f94f608a0887fe25312310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:20.689638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:20.689918 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:20.690193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:20.699336 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:20.700785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:20.709482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1414/2833] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:30.591912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:30.705581 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=70,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:34.646257 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782186d-f75f-41d6-be92-41b983987cc9 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:34.646685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782186d-f75f-41d6-be92-41b983987cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:34.646824 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782186d-f75f-41d6-be92-41b983987cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:34.697398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-5782186d-f75f-41d6-be92-41b983987cc9 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:34.698893 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5782186d-f75f-41d6-be92-41b983987cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:34.762792 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1420/2834] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:34.809150 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:34.810813 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:34.903930 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd4a6-ba94-45b0-9b69-76293f860a20 service glance] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:34.908986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:34.909587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:34.909893 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:34.910160 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:34.918056 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:34.919628 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:34.927464 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1415/2835] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:49:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:49:44.759166 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=40 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:44.924267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=41 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:50.079840 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:50.080334 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:50.080436 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:50.101163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:50.102373 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:50.109730 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1421/2836] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:50.123009 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:50.133437 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0210bf-eab1-4959-85e0-aa541a684ece service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:50.139108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:50.139761 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:50.140040 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:50.140314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:50.148217 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:50.149894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ae491-3b3f-4e16-8dc5-bf71097bb7aa service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:50.158594 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1416/2837] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:49:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:49:50.888194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:50.950613 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ac980-dbf1-43dc-ba5b-5a183995a240 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:50.955074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:50.955728 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:50.956006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:50.956277 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] PATH_INFO: `/v3/users/cb79aa1c9727403bb103695a7d195c36` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:50.957394 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb79aa1c9727403bb103695a7d195c36)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:50.959294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.005777 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb79aa1c9727403bb103695a7d195c36'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.017564 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb79aa1c9727403bb103695a7d195c36'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.024653 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb79aa1c9727403bb103695a7d195c36'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.025321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb79aa1c9727403bb103695a7d195c36'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.032339 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb79aa1c9727403bb103695a7d195c36'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.038169 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1422/2838] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:50 2022] DELETE /identity/v3/users/cb79aa1c9727403bb103695a7d195c36 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:51.043113 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.043448 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.043755 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.063959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:51.065137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:51.122484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1417/2839] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:49:51.132737 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.134183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:51.193115 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74898baf-5533-42ff-930c-d0cda6d731d9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.196803 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.197428 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.197699 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.197963 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.207311 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.208768 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc1090-4038-45ff-9cb2-fef0f8fd5763 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.218811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1423/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:51.484522 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.485968 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:51.498431 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdff171-5f16-46f1-84a1-7181e7d381f0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.503229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.503973 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.504299 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.504625 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] PATH_INFO: `/v3/projects/b4218fb2238c43388ec1793c19c6e4ac` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.505764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4218fb2238c43388ec1793c19c6e4ac)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.507725 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.565993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4218fb2238c43388ec1793c19c6e4ac', 'request_id': 'req-8127470c-0733-425d-920d-8194f61c3bd6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.571733 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4218fb2238c43388ec1793c19c6e4ac', 'request_id': 'req-8127470c-0733-425d-920d-8194f61c3bd6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.580133 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4218fb2238c43388ec1793c19c6e4ac', 'request_id': 'req-8127470c-0733-425d-920d-8194f61c3bd6'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.592197 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] The token cache is being invalidate because project b4218fb2238c43388ec1793c19c6e4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:51.592487 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.593125 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8127470c-0733-425d-920d-8194f61c3bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:51.597958 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1418/2841] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:51 2022] DELETE /identity/v3/projects/b4218fb2238c43388ec1793c19c6e4ac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:51.599856 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.600246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.600593 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.621595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:51.622880 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:51.632229 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:51.686341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1424/2842] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:51.694147 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.694434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.694715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.714632 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:51.715983 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:51.724212 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1419/2843] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:51.729212 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.739054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d039f-3049-4479-891c-d8ccc1151bb1 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.743679 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.744843 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.745120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.745411 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.746053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:49:51.746350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.747978 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.765065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1425/2844] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:49:51.765518 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.777752 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b519b0-83ab-4da2-9caa-6920d9bb1ee3 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.783003 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.783676 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.783959 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.784233 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.784863 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.786764 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.815881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1420/2845] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:51 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 08:49:51.820043 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.831183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884903d9-1dc7-4ac3-8588-28ce8dc2f53f admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.892604 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.893246 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.893526 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.893800 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.894460 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.896412 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.919300 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1426/2846] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:51 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:51.923229 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.934054 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f104fb1-0cdf-44e1-b4a3-244358ca9ecc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.938840 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.939434 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.939871 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.940143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.940788 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.942376 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.956610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1421/2847] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:51.957825 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:51.968306 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b07d-270c-40f1-9bae-a5af940324e6 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:51.973106 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:51.973712 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:51.973989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:51.974263 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:51.974902 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:51.976520 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:51.987453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1427/2848] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:51.991520 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.002082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bed22-3ca1-41b3-8be8-fbc35f9e191f admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.006727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.007383 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.007696 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.007986 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] PATH_INFO: `/v3/projects/fabaf2066b6944ff8d91ebc4db5d9ac3/users/75c9bbe136db4bb7affe2b42b3ba6464/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.015834 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.017875 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.023738 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabaf2066b6944ff8d91ebc4db5d9ac3, user_id=75c9bbe136db4bb7affe2b42b3ba6464, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.026427 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417242e8-8414-4be9-86b7-62f2323f03ff admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.051933 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1422/2849] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:51 2022] PUT /identity/v3/projects/fabaf2066b6944ff8d91ebc4db5d9ac3/users/75c9bbe136db4bb7affe2b42b3ba6464/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:52.053538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103641-e2f1-41ad-bf91-89395312129c None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.053785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103641-e2f1-41ad-bf91-89395312129c None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.054052 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103641-e2f1-41ad-bf91-89395312129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.070348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:52.090223 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-50103641-e2f1-41ad-bf91-89395312129c None None] MFA Rules not processed for user `75c9bbe136db4bb7affe2b42b3ba6464`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:52.091445 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-50103641-e2f1-41ad-bf91-89395312129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.106729 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec032-7e0e-456d-919c-294d70796beb admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.126483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:52.157257 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1423/2850] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:52.158112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50103641-e2f1-41ad-bf91-89395312129c None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.163333 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-50103641-e2f1-41ad-bf91-89395312129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.169067 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.169827 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.170301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.170675 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.172545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.185278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.187153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.197869 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1428/2851] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:52.198971 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.200304 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.235597 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50103641-e2f1-41ad-bf91-89395312129c None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.240335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.241038 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.241372 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.241650 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] PATH_INFO: `/v3/users/3e33d51101b14589a7e440be6fdbb20d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.243065 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e33d51101b14589a7e440be6fdbb20d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.245896 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.266459 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7cb1d-3de0-4da1-bdf9-1c9d56d50c9d service placement] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.270197 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.270797 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.271208 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.271512 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.280696 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.282130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.291776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1429/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:52.295571 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e33d51101b14589a7e440be6fdbb20d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.308248 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e33d51101b14589a7e440be6fdbb20d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.308957 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e33d51101b14589a7e440be6fdbb20d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.316925 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e33d51101b14589a7e440be6fdbb20d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.317756 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-eccdc06d-1239-457a-879a-d8ebc610bce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e33d51101b14589a7e440be6fdbb20d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.330389 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1424/2853] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:49:52 2022] DELETE /identity/v3/users/3e33d51101b14589a7e440be6fdbb20d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:52.514941 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.528198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba65ab-bdeb-4b43-a099-8891a5116be2 service cinder] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.625544 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.626294 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.626500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.626708 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] PATH_INFO: `/v3/projects/79af4e4c37954eccba4385577ce68dcd` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.627873 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79af4e4c37954eccba4385577ce68dcd)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.629776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.687779 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79af4e4c37954eccba4385577ce68dcd', 'request_id': 'req-bcd4316c-494d-47db-91d6-aa8d5c55838e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.693659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79af4e4c37954eccba4385577ce68dcd', 'request_id': 'req-bcd4316c-494d-47db-91d6-aa8d5c55838e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.695432 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:52.701684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79af4e4c37954eccba4385577ce68dcd', 'request_id': 'req-bcd4316c-494d-47db-91d6-aa8d5c55838e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.714409 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] The token cache is being invalidate because project 79af4e4c37954eccba4385577ce68dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:49:52.714706 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.715330 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-bcd4316c-494d-47db-91d6-aa8d5c55838e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:49:52.716816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1430/2854] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:49:52 2022] DELETE /identity/v3/projects/79af4e4c37954eccba4385577ce68dcd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:52.721784 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.722310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.722310 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.742476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:52.743705 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.754458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:52.809943 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1425/2855] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 08:49:52.817705 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.817989 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.818261 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.838388 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:52.839514 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:52.850774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1431/2856] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:52.857666 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.867969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317297ad-c077-4505-b023-a49ae4fbbd0f None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.872626 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.873230 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.873508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.873781 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] PATH_INFO: `/v3/domains` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.874424 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:49:52.874722 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.876371 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.887810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1426/2857] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:49:52.892236 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.901952 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3e85c-b44f-4704-bd04-43f8ab3af31d None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:52.906530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:52.907112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:52.907380 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:52.907685 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:52.908301 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:52.910172 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:52.938007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1432/2858] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:52.942149 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:52.954153 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8b4a-b34e-42c4-9b86-c2b40329896e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:53.012728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:53.013335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.013610 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.013878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] PATH_INFO: `/v3/users` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.014521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:53.016490 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:53.036454 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1427/2859] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:49:52 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:49:53.040595 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:53.051683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f322d6-550c-4979-bf1d-f15832f331c7 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:53.057402 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:53.057997 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.058275 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.058545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.059186 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:53.060821 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:53.071146 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1433/2860] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:53.075482 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:53.085539 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52732e84-7e6a-4829-9182-3df3ad833344 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:53.090138 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:53.090665 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.090940 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.091207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.091867 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:53.093419 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3de19-fa28-4b68-a193-70f75acfaa83 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:53.104527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1428/2861] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:49:53.108647 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:53.118527 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20f39-e87d-453d-81c0-4febb60b051a admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:53.123853 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:53.124496 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.124769 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.125040 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] PATH_INFO: `/v3/projects/2e178d565fec4597a8089a7a6850d2ab/users/a6a897aa2a6a4152b55446073a3ba858/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.139442 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e178d565fec4597a8089a7a6850d2ab, user_id=a6a897aa2a6a4152b55446073a3ba858, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:53.148393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:53.160912 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1434/2862] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:49:53 2022] PUT /identity/v3/projects/2e178d565fec4597a8089a7a6850d2ab/users/a6a897aa2a6a4152b55446073a3ba858/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:49:53.173250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287813-c818-4c00-8b04-26c2306471dd None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.173527 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287813-c818-4c00-8b04-26c2306471dd None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.173802 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287813-c818-4c00-8b04-26c2306471dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.205727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-56287813-c818-4c00-8b04-26c2306471dd None None] MFA Rules not processed for user `a6a897aa2a6a4152b55446073a3ba858`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:53.206934 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-56287813-c818-4c00-8b04-26c2306471dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:53.269169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1429/2863] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:49:53.280134 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:49:53.281866 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:53.338707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fb06-e718-4c8a-b239-216e4f8149e9 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:49:53.342350 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:49:53.342879 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:53.343151 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:53.343422 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:53.351497 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:49:53.352937 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495ffd9-4171-47b0-9e03-234a855eb9db service cinder] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:49:53.362116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1435/2864] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:49:56.823055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:49:56.823579 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:49:56.823939 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:49:56.843161 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] MFA Rules not processed for user `a6a897aa2a6a4152b55446073a3ba858`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:49:56.844735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:49:56.851838 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1430/2865] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:49:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:00.524063 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4067e6-e864-430d-9558-206ee9580b6c None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:00.524566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4067e6-e864-430d-9558-206ee9580b6c None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:00.524682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4067e6-e864-430d-9558-206ee9580b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:00.543645 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-1d4067e6-e864-430d-9558-206ee9580b6c None None] MFA Rules not processed for user `73a4f1987dda43068520217d36d99799`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:00.544884 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1d4067e6-e864-430d-9558-206ee9580b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:00.599331 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1436/2866] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:06.837367 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:10.595006 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=82 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:13.143618 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:13.145122 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:13.221026 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac69dff-9d78-4578-8644-71cd751f7214 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:13.226321 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:13.226926 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:13.227203 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:13.227473 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:13.229941 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:13.240320 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:13.242139 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:13.256685 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1431/2867] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:50:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:50:14.196942 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2060-262e-4200-beba-9cf2d2dc9a5b None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:14.197421 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2060-262e-4200-beba-9cf2d2dc9a5b None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:14.197534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa2060-262e-4200-beba-9cf2d2dc9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:14.218089 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-d4fa2060-262e-4200-beba-9cf2d2dc9a5b None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:14.219314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-d4fa2060-262e-4200-beba-9cf2d2dc9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:14.276091 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1437/2868] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:14.287335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:14.288763 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:14.358315 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fbed-77db-4256-a9a4-6756a5958ec5 service nova] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:14.363659 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:14.364270 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:14.364682 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:14.364960 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:14.374604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:14.376266 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:14.384769 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1432/2869] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:50:14.928597 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde349-9343-4a3c-a01f-1074feaaf674 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:14.929194 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde349-9343-4a3c-a01f-1074feaaf674 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:14.929501 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde349-9343-4a3c-a01f-1074feaaf674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:14.950120 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-e0cde349-9343-4a3c-a01f-1074feaaf674 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:14.951315 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e0cde349-9343-4a3c-a01f-1074feaaf674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:14.958431 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1438/2870] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:14.970458 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:14.981785 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087500b1-593e-405f-a55a-40c4d396102c service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:14.986778 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:14.987370 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:14.987683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:14.987956 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:14.996619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:14.998177 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:15.007442 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1433/2871] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:50:15.230860 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cce95-c0fb-41b9-84b4-60e626b5b8c8 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:15.231332 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cce95-c0fb-41b9-84b4-60e626b5b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:15.231450 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cce95-c0fb-41b9-84b4-60e626b5b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:15.251723 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-127cce95-c0fb-41b9-84b4-60e626b5b8c8 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:15.252348 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-127cce95-c0fb-41b9-84b4-60e626b5b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:15.259680 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1439/2872] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 17 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:15.273584 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:15.284669 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dedbe6-48c4-4d1a-9e60-5375a80b7113 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:15.289877 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:15.290477 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:15.291220 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:15.291636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:15.300401 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:15.302048 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:15.310214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1434/2873] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:50:15.631271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:15.631393 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:15.631917 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:15.654445 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] MFA Rules not processed for user `a87ac9986eb54e468cc292bcecbeeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:15.655847 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:15.664683 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1440/2874] 10.222.0.15 () {58 vars in 967 bytes} [Wed Aug 17 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:15.678476 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:15.691828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2995a1-1b5d-4400-a8d5-0cf1cf49cea0 service swift] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:15.702350 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dccb9c74e7a45279ae6f5581a497a6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:15.702976 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:15.703250 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:15.703508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:15.713721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:15.715290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4faa-9877-4441-80e6-ea065ac73259 service swift] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:15.725395 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1435/2875] 10.222.0.15 () {60 vars in 1384 bytes} [Wed Aug 17 08:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 08:50:17.871600 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:17.938203 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ead94-d46a-47ad-bc57-7451b9aff0d5 None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:17.943462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:17.944182 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:17.944537 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:17.944774 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] PATH_INFO: `/v3/users/a6a897aa2a6a4152b55446073a3ba858` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:17.947926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a897aa2a6a4152b55446073a3ba858)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:17.950163 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:18.003956 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a897aa2a6a4152b55446073a3ba858'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.020744 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a897aa2a6a4152b55446073a3ba858'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.031413 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a897aa2a6a4152b55446073a3ba858'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.032529 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a897aa2a6a4152b55446073a3ba858'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.042478 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a897aa2a6a4152b55446073a3ba858'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.052443 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1441/2876] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:50:17 2022] DELETE /identity/v3/users/a6a897aa2a6a4152b55446073a3ba858 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 08:50:18.054583 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:18.055042 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:18.055760 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:18.078506 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:18.080172 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:18.123082 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=100 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:18.155345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1436/2877] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:18.164861 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:18.166347 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:18.173707 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:18.229682 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319fdd-4177-4923-94ab-beff533ea75c admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:18.233406 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:18.233926 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:18.234205 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:18.234475 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:18.245440 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:18.247296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:18.262480 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1442/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:50:18.442636 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:18.444090 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:18.461757 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd41f26-ef47-42e9-9d8f-3b19bbbe9dea None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:18.466561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:18.467190 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:18.467460 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:18.467747 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] PATH_INFO: `/v3/projects/2e178d565fec4597a8089a7a6850d2ab` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:18.468865 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e178d565fec4597a8089a7a6850d2ab)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:18.470728 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:18.519658 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e178d565fec4597a8089a7a6850d2ab', 'request_id': 'req-8c068db5-a2fb-4394-8cc2-d45253d40014'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.525214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e178d565fec4597a8089a7a6850d2ab', 'request_id': 'req-8c068db5-a2fb-4394-8cc2-d45253d40014'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.532267 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e178d565fec4597a8089a7a6850d2ab', 'request_id': 'req-8c068db5-a2fb-4394-8cc2-d45253d40014'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.543731 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] The token cache is being invalidate because project 2e178d565fec4597a8089a7a6850d2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:50:18.544025 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.544693 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-8c068db5-a2fb-4394-8cc2-d45253d40014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:18.546422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1437/2879] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:50:18 2022] DELETE /identity/v3/projects/2e178d565fec4597a8089a7a6850d2ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:28.257168 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=24 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:28.540184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:30.769053 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:30.770471 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:30.783328 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5809f-5943-4488-bd48-23a7d0278f53 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:30.839659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:30.840278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:30.840560 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:30.840833 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] PATH_INFO: `/v3/users/75c9bbe136db4bb7affe2b42b3ba6464` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:30.841964 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c9bbe136db4bb7affe2b42b3ba6464)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:30.843913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:30.888958 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c9bbe136db4bb7affe2b42b3ba6464'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:30.901386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c9bbe136db4bb7affe2b42b3ba6464'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:30.908318 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c9bbe136db4bb7affe2b42b3ba6464'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:30.908940 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c9bbe136db4bb7affe2b42b3ba6464'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:30.915864 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c9bbe136db4bb7affe2b42b3ba6464'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:30.922254 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1443/2880] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:50:30 2022] DELETE /identity/v3/users/75c9bbe136db4bb7affe2b42b3ba6464 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:30.926667 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:30.927124 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:30.927262 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:30.945712 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:30.946894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.004613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1438/2881] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:31.014375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.015830 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.072927 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7514d0-a71c-49dc-8efb-4bb54093bc04 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.076883 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.077483 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.077762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.078034 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.086924 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.088907 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f398-ffd9-487f-be04-760cc7c5ff5b service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.098378 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1444/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:50:31.367290 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.368874 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.383773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa387-acd4-46b3-8a38-e47abf1775d0 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.389091 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.389683 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.389963 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.390243 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] PATH_INFO: `/v3/projects/fabaf2066b6944ff8d91ebc4db5d9ac3` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.391447 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabaf2066b6944ff8d91ebc4db5d9ac3)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.393335 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.442140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabaf2066b6944ff8d91ebc4db5d9ac3', 'request_id': 'req-5bad613a-8bab-4066-a517-579b5ff73617'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:31.448015 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabaf2066b6944ff8d91ebc4db5d9ac3', 'request_id': 'req-5bad613a-8bab-4066-a517-579b5ff73617'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:31.455742 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabaf2066b6944ff8d91ebc4db5d9ac3', 'request_id': 'req-5bad613a-8bab-4066-a517-579b5ff73617'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:31.467296 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] The token cache is being invalidate because project fabaf2066b6944ff8d91ebc4db5d9ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:50:31.467613 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:31.468265 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-5bad613a-8bab-4066-a517-579b5ff73617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:31.469754 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1439/2883] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:50:31 2022] DELETE /identity/v3/projects/fabaf2066b6944ff8d91ebc4db5d9ac3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:31.474599 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.474911 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.475207 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.494338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:31.495531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.512534 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:31.555874 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1445/2884] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:31.563533 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.563894 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.564169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.584018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:31.585209 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.593735 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1440/2885] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:31.597975 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.608088 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33159c72-0f71-4b0c-9194-b9ec882e402e None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.612689 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.613278 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.613551 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.613818 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.614453 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 08:50:31.614752 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.616375 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.628762 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1446/2886] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 17 08:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 08:50:31.633135 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.642938 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4cf5-96d6-4db0-a29b-7452a0c48133 None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.647532 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.648146 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.648421 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.648689 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.649314 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.651184 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.677717 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1441/2887] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 17 08:50:31 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:50:31.682338 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.692539 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde776-aeee-4a33-8ee7-0fe9c94db7cd admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.747467 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.748083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.748356 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.748622 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.749226 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.751135 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.772239 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1447/2888] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 17 08:50:31 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 08:50:31.776422 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.786587 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4ff3-7b35-4cff-9f37-f899af082cdc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.791400 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.792018 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.792292 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.792557 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.793185 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.794772 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.804891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1442/2889] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:50:31.809252 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.819326 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e573-367b-4aa4-9323-8bffb46ad8e2 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.824802 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.825386 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.825662 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.825960 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.826598 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.828211 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dbd2-6e18-41e0-bbdd-5e6de567f868 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.838642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1448/2890] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 17 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 08:50:31.842470 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:31.852123 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53ca99-4513-48a3-95c7-b67904bfd1bd admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:31.856734 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:31.857363 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.857638 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.857908 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] PATH_INFO: `/v3/projects/dedac0d1dd3f4c5f9b9a9d50be24244e/users/900b9f36f9fa429fade36959145c2e7c/roles/218b2ff052cd47ffb87e3861eba25516` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.874085 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedac0d1dd3f4c5f9b9a9d50be24244e, user_id=900b9f36f9fa429fade36959145c2e7c, role_id=218b2ff052cd47ffb87e3861eba25516)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:31.876809 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:31.891409 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1443/2891] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 17 08:50:31 2022] PUT /identity/v3/projects/dedac0d1dd3f4c5f9b9a9d50be24244e/users/900b9f36f9fa429fade36959145c2e7c/roles/218b2ff052cd47ffb87e3861eba25516 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:31.902870 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] REQUEST_METHOD: `POST` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:31.903153 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:31.903454 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:31.930566 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.auth.core [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] MFA Rules not processed for user `900b9f36f9fa429fade36959145c2e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:31.932383 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:31.995614 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1449/2892] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:32.006511 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:32.008207 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:32.031064 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:32.067530 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2ee4b-2a3a-473c-95a5-75ba54a71a0e admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:32.071137 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d70f0f7e72a4d658218f9c8fcf64737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:32.071773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:32.072055 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:32.072329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:32.081298 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:32.082715 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f535-db20-4846-94c4-f59cd44c7bf8 service cinder] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:32.092073 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1444/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:50:32.116674 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:32.136116 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:32.181267 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f19d21-4e19-43a2-859d-3974f233aadf None None] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:32.185882 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:32.186500 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:32.186776 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:32.187054 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] PATH_INFO: `/v3/users/900b9f36f9fa429fade36959145c2e7c` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:32.188198 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900b9f36f9fa429fade36959145c2e7c)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:32.190112 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:32.236321 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900b9f36f9fa429fade36959145c2e7c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.249368 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900b9f36f9fa429fade36959145c2e7c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.256811 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900b9f36f9fa429fade36959145c2e7c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.257531 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900b9f36f9fa429fade36959145c2e7c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.264816 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900b9f36f9fa429fade36959145c2e7c'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.270550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1450/2894] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:50:32 2022] DELETE /identity/v3/users/900b9f36f9fa429fade36959145c2e7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:32.275060 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] REQUEST_METHOD: `POST` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:32.275343 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:32.276258 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:32.294787 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.auth.core [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] MFA Rules not processed for user `0f93f4121d434aed821124eb6820eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 08:50:32.296104 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:32.353469 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1445/2895] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 17 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 08:50:32.363082 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:32.364642 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:32.420528 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e943-3be5-4081-b3d7-710f7b499557 admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:32.424131 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:32.424731 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:32.425007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:32.425271 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:32.434684 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:32.436130 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:32.445509 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1451/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:50:32.717348 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:50:32.719136 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:50:32.733561 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b51e8-66a4-4420-a03a-570822a88baf None None] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:50:32.738727 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:50:32.739567 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:50:32.739847 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:50:32.740130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] PATH_INFO: `/v3/projects/dedac0d1dd3f4c5f9b9a9d50be24244e` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:50:32.741329 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedac0d1dd3f4c5f9b9a9d50be24244e)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:50:32.743201 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:50:32.789730 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedac0d1dd3f4c5f9b9a9d50be24244e', 'request_id': 'req-0ac607f4-c4ff-431e-bc83-45821902c989'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.795774 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedac0d1dd3f4c5f9b9a9d50be24244e', 'request_id': 'req-0ac607f4-c4ff-431e-bc83-45821902c989'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.803024 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedac0d1dd3f4c5f9b9a9d50be24244e', 'request_id': 'req-0ac607f4-c4ff-431e-bc83-45821902c989'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.814214 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] The token cache is being invalidate because project dedac0d1dd3f4c5f9b9a9d50be24244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:50:32.814548 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.815164 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:50:32.816655 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1446/2897] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:50:32 2022] DELETE /identity/v3/projects/dedac0d1dd3f4c5f9b9a9d50be24244e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:50:42.441184 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:42.811169 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:51:56.274233 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:51:56.275775 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:51:56.364625 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8920-f71a-42d3-a841-7f284dae12a7 service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:51:56.451049 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e110ca44c21448c807e788a08126a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:51:56.451692 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:51:56.451970 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:51:56.452242 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:51:56.453962 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:51:56.467362 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:51:56.469312 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:51:56.483673 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1452/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:51:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:51:59.079732 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:51:59.081261 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:51:59.149010 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac607f4-c4ff-431e-bc83-45821902c989 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:51:59.153972 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:51:59.154569 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:51:59.154843 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:51:59.155112 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:51:59.156828 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:51:59.168521 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:51:59.170094 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:51:59.179903 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1447/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:51:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:52:01.771462 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:52:01.772939 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:52:01.829398 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9906ce-3b45-4d44-9121-8a8f843ab0a4 service nova] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:52:01.832933 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7a5e0bc9174566804a188cdcd08047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:52:01.833530 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] REQUEST_METHOD: `GET` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:52:01.833809 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:52:01.834081 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:52:01.835846 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:52:01.874296 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=100 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:52:01.898545 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:52:01.900007 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:52:01.910100 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1453/2900] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:52:08.087344 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:52:08.088891 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:52:08.102904 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b4e87-8fc8-468e-bf85-1b40fc7d715d service placement] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:52:08.107497 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:52:08.108263 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:52:08.108541 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:52:08.108810 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] PATH_INFO: `/v3/users/73a4f1987dda43068520217d36d99799` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:52:08.109905 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a4f1987dda43068520217d36d99799)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:52:08.111826 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:52:08.157031 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a4f1987dda43068520217d36d99799'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.168844 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a4f1987dda43068520217d36d99799'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.169495 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a4f1987dda43068520217d36d99799'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.176721 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a4f1987dda43068520217d36d99799'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.177365 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a4f1987dda43068520217d36d99799'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.190008 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1448/2901] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:52:08 2022] DELETE /identity/v3/users/73a4f1987dda43068520217d36d99799 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:52:08.365550 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:52:08.376736 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d8e6-af21-4859-b7b0-92a3300fb1cc service neutron] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:52:08.433083 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:52:08.434219 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:52:08.434491 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:52:08.434756 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] PATH_INFO: `/v3/projects/e2604417eb5f48f0b026b00a9c164e08` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:52:08.435913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2604417eb5f48f0b026b00a9c164e08)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:52:08.437787 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:52:08.483161 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2604417eb5f48f0b026b00a9c164e08', 'request_id': 'req-58eda13f-372f-4d2d-b997-c19ae81e968b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.488659 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2604417eb5f48f0b026b00a9c164e08', 'request_id': 'req-58eda13f-372f-4d2d-b997-c19ae81e968b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.495588 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2604417eb5f48f0b026b00a9c164e08', 'request_id': 'req-58eda13f-372f-4d2d-b997-c19ae81e968b'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.506783 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] The token cache is being invalidate because project e2604417eb5f48f0b026b00a9c164e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:52:08.507065 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.507713 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.509152 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1454/2902] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:52:08 2022] DELETE /identity/v3/projects/e2604417eb5f48f0b026b00a9c164e08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:52:08.513786 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:52:08.515297 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:52:08.528463 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755638e7-b2c5-4a71-97be-e98e72df06f4 admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:52:08.585773 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:52:08.586325 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:52:08.586604 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:52:08.586878 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] PATH_INFO: `/v3/users/3109516109494a4f8749bd1addf2ca2d` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:52:08.588108 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3109516109494a4f8749bd1addf2ca2d)` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:52:08.594381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:52:08.594381 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:52:08.642403 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3109516109494a4f8749bd1addf2ca2d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.654484 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3109516109494a4f8749bd1addf2ca2d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.655140 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3109516109494a4f8749bd1addf2ca2d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.662969 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3109516109494a4f8749bd1addf2ca2d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.663619 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.notifications [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3109516109494a4f8749bd1addf2ca2d'} {{(pid=81595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.675979 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1449/2903] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 17 08:52:08 2022] DELETE /identity/v3/users/3109516109494a4f8749bd1addf2ca2d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:52:08.847417 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Authenticating user token {{(pid=81594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:52:08.849027 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.fernet_utils [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:52:08.862381 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eda13f-372f-4d2d-b997-c19ae81e968b admin admin] Validating token access rules against request {{(pid=81594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:52:08.920005 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f93f4121d434aed821124eb6820eb0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0453a8b2bb634303b77e24e668baded5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:52:08.920633 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:52:08.920913 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:52:08.921183 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] PATH_INFO: `/v3/projects/881e81e98074458d9cd4ddd43f67d851` {{(pid=81594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:52:08.922292 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=881e81e98074458d9cd4ddd43f67d851)` {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:52:08.924244 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] RBAC: Authorization granted {{(pid=81594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:52:08.930341 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:52:08.971074 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881e81e98074458d9cd4ddd43f67d851', 'request_id': 'req-f44118d6-0639-4ca8-85b3-4348a3843e7e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.976609 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881e81e98074458d9cd4ddd43f67d851', 'request_id': 'req-f44118d6-0639-4ca8-85b3-4348a3843e7e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.984314 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881e81e98074458d9cd4ddd43f67d851', 'request_id': 'req-f44118d6-0639-4ca8-85b3-4348a3843e7e'} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.995640 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] The token cache is being invalidate because project 881e81e98074458d9cd4ddd43f67d851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 08:52:08.996472 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.997303 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG keystone.notifications [None req-f44118d6-0639-4ca8-85b3-4348a3843e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 08:52:08.999039 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: [pid: 81594|app: 0|req: 1455/2904] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 17 08:52:08 2022] DELETE /identity/v3/projects/881e81e98074458d9cd4ddd43f67d851 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 08:52:18.672538 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:52:18.993052 dv-cinder-853315-5-iscsi devstack@keystone.service[81594]: DEBUG dbcounter [-] [81594] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:57:13.538193 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Authenticating user token {{(pid=81595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 08:57:13.539596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:57:13.678345 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c771787-d1a6-4d09-8acb-009c1a7bb3cc admin admin] Validating token access rules against request {{(pid=81595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 08:57:13.735993 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c853b65b78d44a8a5656c1b84b4bff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad994fe60eb4c22958e0e687dd6bf93', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 08:57:13.736596 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] REQUEST_METHOD: `GET` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 08:57:13.736873 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] SCRIPT_NAME: `/identity` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 08:57:13.737143 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 08:57:13.738881 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.fernet_utils [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 08:57:13.749948 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 08:57:13.751508 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df77b4c-ff1b-4af0-9dbd-cd6660033d17 service placement] RBAC: Authorization granted {{(pid=81595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 08:57:13.761328 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: [pid: 81595|app: 0|req: 1450/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 17 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 08:57:23.757130 dv-cinder-853315-5-iscsi devstack@keystone.service[81595]: DEBUG dbcounter [-] [81595] Writing DB stats keystone:SELECT=89 {{(pid=81595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}